&&&& RUNNING TensorRT.trtexec [TensorRT v8400] # /usr/src/tensorrt/bin/trtexec --onnx=c3dv2.3.k4.onnx --saveEngine=c3d_best.engine --best --allowGPUFallback --verbose
[11/24/2022-12:07:34] [I] === Model Options ===
[11/24/2022-12:07:34] [I] Format: ONNX
[11/24/2022-12:07:34] [I] Model: c3dv2.3.k4.onnx
[11/24/2022-12:07:34] [I] Output:
[11/24/2022-12:07:34] [I] === Build Options ===
[11/24/2022-12:07:34] [I] Max batch: explicit batch
[11/24/2022-12:07:34] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
[11/24/2022-12:07:34] [I] minTiming: 1
[11/24/2022-12:07:34] [I] avgTiming: 8
[11/24/2022-12:07:34] [I] Precision: FP32+FP16+INT8
[11/24/2022-12:07:34] [I] LayerPrecisions: 
[11/24/2022-12:07:34] [I] Calibration: Dynamic
[11/24/2022-12:07:34] [I] Refit: Disabled
[11/24/2022-12:07:34] [I] Sparsity: Disabled
[11/24/2022-12:07:34] [I] Safe mode: Disabled
[11/24/2022-12:07:34] [I] DirectIO mode: Disabled
[11/24/2022-12:07:34] [I] Restricted mode: Disabled
[11/24/2022-12:07:34] [I] Build only: Disabled
[11/24/2022-12:07:34] [I] Save engine: c3d_best.engine
[11/24/2022-12:07:34] [I] Load engine: 
[11/24/2022-12:07:34] [I] Profiling verbosity: 0
[11/24/2022-12:07:34] [I] Tactic sources: Using default tactic sources
[11/24/2022-12:07:34] [I] timingCacheMode: local
[11/24/2022-12:07:34] [I] timingCacheFile: 
[11/24/2022-12:07:34] [I] Input(s)s format: fp32:CHW
[11/24/2022-12:07:34] [I] Output(s)s format: fp32:CHW
[11/24/2022-12:07:34] [I] Input build shapes: model
[11/24/2022-12:07:34] [I] Input calibration shapes: model
[11/24/2022-12:07:34] [I] === System Options ===
[11/24/2022-12:07:34] [I] Device: 0
[11/24/2022-12:07:34] [I] DLACore: 
[11/24/2022-12:07:34] [I] Plugins:
[11/24/2022-12:07:34] [I] === Inference Options ===
[11/24/2022-12:07:34] [I] Batch: Explicit
[11/24/2022-12:07:34] [I] Input inference shapes: model
[11/24/2022-12:07:34] [I] Iterations: 10
[11/24/2022-12:07:34] [I] Duration: 3s (+ 200ms warm up)
[11/24/2022-12:07:34] [I] Sleep time: 0ms
[11/24/2022-12:07:34] [I] Idle time: 0ms
[11/24/2022-12:07:34] [I] Streams: 1
[11/24/2022-12:07:34] [I] ExposeDMA: Disabled
[11/24/2022-12:07:34] [I] Data transfers: Enabled
[11/24/2022-12:07:34] [I] Spin-wait: Disabled
[11/24/2022-12:07:34] [I] Multithreading: Disabled
[11/24/2022-12:07:34] [I] CUDA Graph: Disabled
[11/24/2022-12:07:34] [I] Separate profiling: Disabled
[11/24/2022-12:07:34] [I] Time Deserialize: Disabled
[11/24/2022-12:07:34] [I] Time Refit: Disabled
[11/24/2022-12:07:34] [I] Inputs:
[11/24/2022-12:07:34] [I] === Reporting Options ===
[11/24/2022-12:07:34] [I] Verbose: Enabled
[11/24/2022-12:07:34] [I] Averages: 10 inferences
[11/24/2022-12:07:34] [I] Percentile: 99
[11/24/2022-12:07:34] [I] Dump refittable layers:Disabled
[11/24/2022-12:07:34] [I] Dump output: Disabled
[11/24/2022-12:07:34] [I] Profile: Disabled
[11/24/2022-12:07:34] [I] Export timing to JSON file: 
[11/24/2022-12:07:34] [I] Export output to JSON file: 
[11/24/2022-12:07:34] [I] Export profile to JSON file: 
[11/24/2022-12:07:34] [I] 
[11/24/2022-12:07:34] [I] === Device Information ===
[11/24/2022-12:07:34] [I] Selected Device: Orin
[11/24/2022-12:07:34] [I] Compute Capability: 8.7
[11/24/2022-12:07:34] [I] SMs: 16
[11/24/2022-12:07:34] [I] Compute Clock Rate: 1.3 GHz
[11/24/2022-12:07:34] [I] Device Global Memory: 30622 MiB
[11/24/2022-12:07:34] [I] Shared Memory per SM: 164 KiB
[11/24/2022-12:07:34] [I] Memory Bus Width: 128 bits (ECC disabled)
[11/24/2022-12:07:34] [I] Memory Clock Rate: 1.3 GHz
[11/24/2022-12:07:34] [I] 
[11/24/2022-12:07:34] [I] TensorRT version: 8.4.0
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::Proposal version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::Split version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2
[11/24/2022-12:07:34] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1
[11/24/2022-12:07:36] [I] [TRT] [MemUsageChange] Init CUDA: CPU +302, GPU +0, now: CPU 327, GPU 4495 (MiB)
[11/24/2022-12:07:38] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +403, GPU +534, now: CPU 749, GPU 5049 (MiB)
[11/24/2022-12:07:38] [I] Start parsing network model
[11/24/2022-12:07:38] [I] [TRT] ----------------------------------------------------------------
[11/24/2022-12:07:38] [I] [TRT] Input filename:   c3dv2.3.k4.onnx
[11/24/2022-12:07:38] [I] [TRT] ONNX IR version:  0.0.4
[11/24/2022-12:07:38] [I] [TRT] Opset version:    10
[11/24/2022-12:07:38] [I] [TRT] Producer name:    pytorch
[11/24/2022-12:07:38] [I] [TRT] Producer version: 1.3
[11/24/2022-12:07:38] [I] [TRT] Domain:           
[11/24/2022-12:07:38] [I] [TRT] Model version:    0
[11/24/2022-12:07:38] [I] [TRT] Doc string:       
[11/24/2022-12:07:38] [I] [TRT] ----------------------------------------------------------------
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::Split version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2
[11/24/2022-12:07:38] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1
[11/24/2022-12:07:38] [V] [TRT] Adding network input: i with dtype: float32, dimensions: (1, 3, 352, 672)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: i for ONNX tensor: i
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: a
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: amodel_offset.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: amodel_offset.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: amodel_offset.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: amodel_offset.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.0.1.num_batches_tracked
[11/24/2022-12:07:38] [W] [TRT] onnx2trt_utils.cpp:363: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.2.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.2.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.2.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.1.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.10.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.11.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.12.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.13.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.14.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.15.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.16.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.17.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.2.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.3.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.4.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.5.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.6.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.7.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.8.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.0.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.1.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.3.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: backbone.features.9.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep_uncertainty.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep_uncertainty.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep_uncertainty.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dep_uncertainty.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dim.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dim.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dim.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: dim.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: e
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: g
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcp_offset.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcp_offset.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcp_offset.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcp_offset.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps_loff.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps_loff.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps_loff.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: gcps_loff.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_gcp.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_gcp.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_gcp.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_gcp.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_stixel.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_stixel.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_stixel.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_stixel.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_trunc.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_trunc.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_trunc.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: hm_trunc.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_auxi_im.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_auxi_im.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_auxi_im.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_auxi_im.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_category.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_category.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_category.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_category.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_color.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_color.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_color.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_color.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_h.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_h.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_h.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_h.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_im.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_im.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_im.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_im.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_off.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_off.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_off.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_off.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_pm.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_pm.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_pm.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: lane_pm.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: latd.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: latd.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: latd.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: latd.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: m
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.node_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.proj_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_0.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_2.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.node_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_2.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.proj_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_1.up_2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_2.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_3.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_3.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_3.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_3.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_3.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.node_3.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_2.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_3.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_3.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_3.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_3.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_3.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.proj_3.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.up_2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.dla_up.ida_2.up_3.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_2.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.node_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_1.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_2.conv.1.num_batches_tracked
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.proj_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.up_2.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: neck.ida_up.up_2.1.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg_stixel.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg_stixel.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg_stixel.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: reg_stixel.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: rot.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: rot.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: rot.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: rot.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: scene.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: scene.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: scene.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: scene.2.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: wh.0.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: wh.0.weight
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: wh.2.bias
[11/24/2022-12:07:38] [V] [TRT] Importing initializer: wh.2.weight
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_509 [Cast]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: m
[11/24/2022-12:07:38] [V] [TRT] node_of_509 [Cast] inputs: [m -> (1, 2, 352, 672)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: m for ONNX node: m
[11/24/2022-12:07:38] [V] [TRT] Casting to type: float32
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_509 for ONNX node: node_of_509
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 509 for ONNX tensor: 509
[11/24/2022-12:07:38] [V] [TRT] node_of_509 [Cast] outputs: [509 -> (1, 2, 352, 672)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_510 [Concat]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: i
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 509
[11/24/2022-12:07:38] [V] [TRT] node_of_510 [Concat] inputs: [i -> (1, 3, 352, 672)[FLOAT]], [509 -> (1, 2, 352, 672)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_510 for ONNX node: node_of_510
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 510 for ONNX tensor: 510
[11/24/2022-12:07:38] [V] [TRT] node_of_510 [Concat] outputs: [510 -> (1, 5, 352, 672)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_511 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 510
[11/24/2022-12:07:38] [V] [TRT] Searching for input: a
[11/24/2022-12:07:38] [V] [TRT] node_of_511 [Conv] inputs: [510 -> (1, 5, 352, 672)[FLOAT]], [a -> (32, 5, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 5, 352, 672)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_511 for ONNX node: node_of_511
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511
[11/24/2022-12:07:38] [V] [TRT] node_of_511 [Conv] outputs: [511 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_512 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 511
[11/24/2022-12:07:38] [V] [TRT] Searching for input: g
[11/24/2022-12:07:38] [V] [TRT] Searching for input: e
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_512 [BatchNormalization] inputs: [511 -> (1, 32, 176, 336)[FLOAT]], [g -> (32)[FLOAT]], [e -> (32)[FLOAT]], [backbone.features.0.1.running_mean -> (32)[FLOAT]], [backbone.features.0.1.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_512 for ONNX node: node_of_512
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 512 for ONNX tensor: 512
[11/24/2022-12:07:38] [V] [TRT] node_of_512 [BatchNormalization] outputs: [512 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_513 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 512
[11/24/2022-12:07:38] [V] [TRT] node_of_513 [Clip] inputs: [512 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_513 for ONNX node: node_of_513
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 513 for ONNX tensor: 513
[11/24/2022-12:07:38] [V] [TRT] node_of_513 [Clip] outputs: [513 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_514 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 513
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_514 [Conv] inputs: [513 -> (1, 32, 176, 336)[FLOAT]], [backbone.features.1.conv.0.0.weight -> (32, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_514 for ONNX node: node_of_514
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 514 for ONNX tensor: 514
[11/24/2022-12:07:38] [V] [TRT] node_of_514 [Conv] outputs: [514 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_515 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 514
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_515 [BatchNormalization] inputs: [514 -> (1, 32, 176, 336)[FLOAT]], [backbone.features.1.conv.0.1.weight -> (32)[FLOAT]], [backbone.features.1.conv.0.1.bias -> (32)[FLOAT]], [backbone.features.1.conv.0.1.running_mean -> (32)[FLOAT]], [backbone.features.1.conv.0.1.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_515 for ONNX node: node_of_515
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 515 for ONNX tensor: 515
[11/24/2022-12:07:38] [V] [TRT] node_of_515 [BatchNormalization] outputs: [515 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_516 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 515
[11/24/2022-12:07:38] [V] [TRT] node_of_516 [Clip] inputs: [515 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_516 for ONNX node: node_of_516
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 516 for ONNX tensor: 516
[11/24/2022-12:07:38] [V] [TRT] node_of_516 [Clip] outputs: [516 -> (1, 32, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_517 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 516
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_517 [Conv] inputs: [516 -> (1, 32, 176, 336)[FLOAT]], [backbone.features.1.conv.1.weight -> (16, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_517 for ONNX node: node_of_517
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 16, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 517 for ONNX tensor: 517
[11/24/2022-12:07:38] [V] [TRT] node_of_517 [Conv] outputs: [517 -> (1, 16, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_518 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 517
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.2.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.2.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.1.conv.2.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_518 [BatchNormalization] inputs: [517 -> (1, 16, 176, 336)[FLOAT]], [backbone.features.1.conv.2.weight -> (16)[FLOAT]], [backbone.features.1.conv.2.bias -> (16)[FLOAT]], [backbone.features.1.conv.2.running_mean -> (16)[FLOAT]], [backbone.features.1.conv.2.running_var -> (16)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_518 for ONNX node: node_of_518
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518
[11/24/2022-12:07:38] [V] [TRT] node_of_518 [BatchNormalization] outputs: [518 -> (1, 16, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_519 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 518
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_519 [Conv] inputs: [518 -> (1, 16, 176, 336)[FLOAT]], [backbone.features.2.conv.0.0.weight -> (96, 16, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 16, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_519 for ONNX node: node_of_519
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 519 for ONNX tensor: 519
[11/24/2022-12:07:38] [V] [TRT] node_of_519 [Conv] outputs: [519 -> (1, 96, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_520 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 519
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_520 [BatchNormalization] inputs: [519 -> (1, 96, 176, 336)[FLOAT]], [backbone.features.2.conv.0.1.weight -> (96)[FLOAT]], [backbone.features.2.conv.0.1.bias -> (96)[FLOAT]], [backbone.features.2.conv.0.1.running_mean -> (96)[FLOAT]], [backbone.features.2.conv.0.1.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_520 for ONNX node: node_of_520
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520
[11/24/2022-12:07:38] [V] [TRT] node_of_520 [BatchNormalization] outputs: [520 -> (1, 96, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_521 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 520
[11/24/2022-12:07:38] [V] [TRT] node_of_521 [Clip] inputs: [520 -> (1, 96, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_521 for ONNX node: node_of_521
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 521 for ONNX tensor: 521
[11/24/2022-12:07:38] [V] [TRT] node_of_521 [Clip] outputs: [521 -> (1, 96, 176, 336)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_522 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 521
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_522 [Conv] inputs: [521 -> (1, 96, 176, 336)[FLOAT]], [backbone.features.2.conv.1.0.weight -> (96, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 176, 336)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_522 for ONNX node: node_of_522
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 522 for ONNX tensor: 522
[11/24/2022-12:07:38] [V] [TRT] node_of_522 [Conv] outputs: [522 -> (1, 96, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_523 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 522
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_523 [BatchNormalization] inputs: [522 -> (1, 96, 88, 168)[FLOAT]], [backbone.features.2.conv.1.1.weight -> (96)[FLOAT]], [backbone.features.2.conv.1.1.bias -> (96)[FLOAT]], [backbone.features.2.conv.1.1.running_mean -> (96)[FLOAT]], [backbone.features.2.conv.1.1.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_523 for ONNX node: node_of_523
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 523 for ONNX tensor: 523
[11/24/2022-12:07:38] [V] [TRT] node_of_523 [BatchNormalization] outputs: [523 -> (1, 96, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_524 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 523
[11/24/2022-12:07:38] [V] [TRT] node_of_524 [Clip] inputs: [523 -> (1, 96, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_524 for ONNX node: node_of_524
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 524 for ONNX tensor: 524
[11/24/2022-12:07:38] [V] [TRT] node_of_524 [Clip] outputs: [524 -> (1, 96, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_525 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 524
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_525 [Conv] inputs: [524 -> (1, 96, 88, 168)[FLOAT]], [backbone.features.2.conv.2.weight -> (24, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_525 for ONNX node: node_of_525
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 525 for ONNX tensor: 525
[11/24/2022-12:07:38] [V] [TRT] node_of_525 [Conv] outputs: [525 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_526 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 525
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.2.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_526 [BatchNormalization] inputs: [525 -> (1, 24, 88, 168)[FLOAT]], [backbone.features.2.conv.3.weight -> (24)[FLOAT]], [backbone.features.2.conv.3.bias -> (24)[FLOAT]], [backbone.features.2.conv.3.running_mean -> (24)[FLOAT]], [backbone.features.2.conv.3.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_526 for ONNX node: node_of_526
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 526 for ONNX tensor: 526
[11/24/2022-12:07:38] [V] [TRT] node_of_526 [BatchNormalization] outputs: [526 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_527 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 526
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_527 [Conv] inputs: [526 -> (1, 24, 88, 168)[FLOAT]], [backbone.features.3.conv.0.0.weight -> (144, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_527 for ONNX node: node_of_527
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 144, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 527 for ONNX tensor: 527
[11/24/2022-12:07:38] [V] [TRT] node_of_527 [Conv] outputs: [527 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_528 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 527
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_528 [BatchNormalization] inputs: [527 -> (1, 144, 88, 168)[FLOAT]], [backbone.features.3.conv.0.1.weight -> (144)[FLOAT]], [backbone.features.3.conv.0.1.bias -> (144)[FLOAT]], [backbone.features.3.conv.0.1.running_mean -> (144)[FLOAT]], [backbone.features.3.conv.0.1.running_var -> (144)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_528 for ONNX node: node_of_528
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 528 for ONNX tensor: 528
[11/24/2022-12:07:38] [V] [TRT] node_of_528 [BatchNormalization] outputs: [528 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_529 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 528
[11/24/2022-12:07:38] [V] [TRT] node_of_529 [Clip] inputs: [528 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_529 for ONNX node: node_of_529
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 529 for ONNX tensor: 529
[11/24/2022-12:07:38] [V] [TRT] node_of_529 [Clip] outputs: [529 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_530 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 529
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_530 [Conv] inputs: [529 -> (1, 144, 88, 168)[FLOAT]], [backbone.features.3.conv.1.0.weight -> (144, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 144, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_530 for ONNX node: node_of_530
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 144
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 144, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 530 for ONNX tensor: 530
[11/24/2022-12:07:38] [V] [TRT] node_of_530 [Conv] outputs: [530 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_531 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 530
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_531 [BatchNormalization] inputs: [530 -> (1, 144, 88, 168)[FLOAT]], [backbone.features.3.conv.1.1.weight -> (144)[FLOAT]], [backbone.features.3.conv.1.1.bias -> (144)[FLOAT]], [backbone.features.3.conv.1.1.running_mean -> (144)[FLOAT]], [backbone.features.3.conv.1.1.running_var -> (144)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_531 for ONNX node: node_of_531
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531
[11/24/2022-12:07:38] [V] [TRT] node_of_531 [BatchNormalization] outputs: [531 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_532 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 531
[11/24/2022-12:07:38] [V] [TRT] node_of_532 [Clip] inputs: [531 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_532 for ONNX node: node_of_532
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532
[11/24/2022-12:07:38] [V] [TRT] node_of_532 [Clip] outputs: [532 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_533 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 532
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_533 [Conv] inputs: [532 -> (1, 144, 88, 168)[FLOAT]], [backbone.features.3.conv.2.weight -> (24, 144, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 144, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_533 for ONNX node: node_of_533
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 533 for ONNX tensor: 533
[11/24/2022-12:07:38] [V] [TRT] node_of_533 [Conv] outputs: [533 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_534 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 533
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.3.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_534 [BatchNormalization] inputs: [533 -> (1, 24, 88, 168)[FLOAT]], [backbone.features.3.conv.3.weight -> (24)[FLOAT]], [backbone.features.3.conv.3.bias -> (24)[FLOAT]], [backbone.features.3.conv.3.running_mean -> (24)[FLOAT]], [backbone.features.3.conv.3.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_534 for ONNX node: node_of_534
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 534 for ONNX tensor: 534
[11/24/2022-12:07:38] [V] [TRT] node_of_534 [BatchNormalization] outputs: [534 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_535 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 526
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 534
[11/24/2022-12:07:38] [V] [TRT] node_of_535 [Add] inputs: [526 -> (1, 24, 88, 168)[FLOAT]], [534 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_535 for ONNX node: node_of_535
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535
[11/24/2022-12:07:38] [V] [TRT] node_of_535 [Add] outputs: [535 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_536 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 535
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_536 [Conv] inputs: [535 -> (1, 24, 88, 168)[FLOAT]], [backbone.features.4.conv.0.0.weight -> (144, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_536 for ONNX node: node_of_536
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 144, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 536 for ONNX tensor: 536
[11/24/2022-12:07:38] [V] [TRT] node_of_536 [Conv] outputs: [536 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_537 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 536
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_537 [BatchNormalization] inputs: [536 -> (1, 144, 88, 168)[FLOAT]], [backbone.features.4.conv.0.1.weight -> (144)[FLOAT]], [backbone.features.4.conv.0.1.bias -> (144)[FLOAT]], [backbone.features.4.conv.0.1.running_mean -> (144)[FLOAT]], [backbone.features.4.conv.0.1.running_var -> (144)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_537 for ONNX node: node_of_537
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537
[11/24/2022-12:07:38] [V] [TRT] node_of_537 [BatchNormalization] outputs: [537 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_538 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 537
[11/24/2022-12:07:38] [V] [TRT] node_of_538 [Clip] inputs: [537 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_538 for ONNX node: node_of_538
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 538 for ONNX tensor: 538
[11/24/2022-12:07:38] [V] [TRT] node_of_538 [Clip] outputs: [538 -> (1, 144, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_539 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 538
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_539 [Conv] inputs: [538 -> (1, 144, 88, 168)[FLOAT]], [backbone.features.4.conv.1.0.weight -> (144, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 144, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_539 for ONNX node: node_of_539
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 144
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 144, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 539 for ONNX tensor: 539
[11/24/2022-12:07:38] [V] [TRT] node_of_539 [Conv] outputs: [539 -> (1, 144, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_540 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 539
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_540 [BatchNormalization] inputs: [539 -> (1, 144, 44, 84)[FLOAT]], [backbone.features.4.conv.1.1.weight -> (144)[FLOAT]], [backbone.features.4.conv.1.1.bias -> (144)[FLOAT]], [backbone.features.4.conv.1.1.running_mean -> (144)[FLOAT]], [backbone.features.4.conv.1.1.running_var -> (144)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_540 for ONNX node: node_of_540
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540
[11/24/2022-12:07:38] [V] [TRT] node_of_540 [BatchNormalization] outputs: [540 -> (1, 144, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_541 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 540
[11/24/2022-12:07:38] [V] [TRT] node_of_541 [Clip] inputs: [540 -> (1, 144, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_541 for ONNX node: node_of_541
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 541 for ONNX tensor: 541
[11/24/2022-12:07:38] [V] [TRT] node_of_541 [Clip] outputs: [541 -> (1, 144, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_542 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 541
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_542 [Conv] inputs: [541 -> (1, 144, 44, 84)[FLOAT]], [backbone.features.4.conv.2.weight -> (32, 144, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 144, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_542 for ONNX node: node_of_542
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 542 for ONNX tensor: 542
[11/24/2022-12:07:38] [V] [TRT] node_of_542 [Conv] outputs: [542 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_543 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 542
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.4.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_543 [BatchNormalization] inputs: [542 -> (1, 32, 44, 84)[FLOAT]], [backbone.features.4.conv.3.weight -> (32)[FLOAT]], [backbone.features.4.conv.3.bias -> (32)[FLOAT]], [backbone.features.4.conv.3.running_mean -> (32)[FLOAT]], [backbone.features.4.conv.3.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_543 for ONNX node: node_of_543
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 543 for ONNX tensor: 543
[11/24/2022-12:07:38] [V] [TRT] node_of_543 [BatchNormalization] outputs: [543 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_544 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 543
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_544 [Conv] inputs: [543 -> (1, 32, 44, 84)[FLOAT]], [backbone.features.5.conv.0.0.weight -> (192, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_544 for ONNX node: node_of_544
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 544 for ONNX tensor: 544
[11/24/2022-12:07:38] [V] [TRT] node_of_544 [Conv] outputs: [544 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_545 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 544
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_545 [BatchNormalization] inputs: [544 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.5.conv.0.1.weight -> (192)[FLOAT]], [backbone.features.5.conv.0.1.bias -> (192)[FLOAT]], [backbone.features.5.conv.0.1.running_mean -> (192)[FLOAT]], [backbone.features.5.conv.0.1.running_var -> (192)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_545 for ONNX node: node_of_545
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 545 for ONNX tensor: 545
[11/24/2022-12:07:38] [V] [TRT] node_of_545 [BatchNormalization] outputs: [545 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_546 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 545
[11/24/2022-12:07:38] [V] [TRT] node_of_546 [Clip] inputs: [545 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_546 for ONNX node: node_of_546
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 546 for ONNX tensor: 546
[11/24/2022-12:07:38] [V] [TRT] node_of_546 [Clip] outputs: [546 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_547 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 546
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_547 [Conv] inputs: [546 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.5.conv.1.0.weight -> (192, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_547 for ONNX node: node_of_547
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 547 for ONNX tensor: 547
[11/24/2022-12:07:38] [V] [TRT] node_of_547 [Conv] outputs: [547 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_548 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 547
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_548 [BatchNormalization] inputs: [547 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.5.conv.1.1.weight -> (192)[FLOAT]], [backbone.features.5.conv.1.1.bias -> (192)[FLOAT]], [backbone.features.5.conv.1.1.running_mean -> (192)[FLOAT]], [backbone.features.5.conv.1.1.running_var -> (192)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_548 for ONNX node: node_of_548
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 548 for ONNX tensor: 548
[11/24/2022-12:07:38] [V] [TRT] node_of_548 [BatchNormalization] outputs: [548 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_549 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 548
[11/24/2022-12:07:38] [V] [TRT] node_of_549 [Clip] inputs: [548 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_549 for ONNX node: node_of_549
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549
[11/24/2022-12:07:38] [V] [TRT] node_of_549 [Clip] outputs: [549 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_550 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 549
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_550 [Conv] inputs: [549 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.5.conv.2.weight -> (32, 192, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_550 for ONNX node: node_of_550
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 550 for ONNX tensor: 550
[11/24/2022-12:07:38] [V] [TRT] node_of_550 [Conv] outputs: [550 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_551 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 550
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.5.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_551 [BatchNormalization] inputs: [550 -> (1, 32, 44, 84)[FLOAT]], [backbone.features.5.conv.3.weight -> (32)[FLOAT]], [backbone.features.5.conv.3.bias -> (32)[FLOAT]], [backbone.features.5.conv.3.running_mean -> (32)[FLOAT]], [backbone.features.5.conv.3.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_551 for ONNX node: node_of_551
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 551 for ONNX tensor: 551
[11/24/2022-12:07:38] [V] [TRT] node_of_551 [BatchNormalization] outputs: [551 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_552 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 543
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 551
[11/24/2022-12:07:38] [V] [TRT] node_of_552 [Add] inputs: [543 -> (1, 32, 44, 84)[FLOAT]], [551 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_552 for ONNX node: node_of_552
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552
[11/24/2022-12:07:38] [V] [TRT] node_of_552 [Add] outputs: [552 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_553 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 552
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_553 [Conv] inputs: [552 -> (1, 32, 44, 84)[FLOAT]], [backbone.features.6.conv.0.0.weight -> (192, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_553 for ONNX node: node_of_553
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553
[11/24/2022-12:07:38] [V] [TRT] node_of_553 [Conv] outputs: [553 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_554 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 553
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_554 [BatchNormalization] inputs: [553 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.6.conv.0.1.weight -> (192)[FLOAT]], [backbone.features.6.conv.0.1.bias -> (192)[FLOAT]], [backbone.features.6.conv.0.1.running_mean -> (192)[FLOAT]], [backbone.features.6.conv.0.1.running_var -> (192)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_554 for ONNX node: node_of_554
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 554 for ONNX tensor: 554
[11/24/2022-12:07:38] [V] [TRT] node_of_554 [BatchNormalization] outputs: [554 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_555 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 554
[11/24/2022-12:07:38] [V] [TRT] node_of_555 [Clip] inputs: [554 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_555 for ONNX node: node_of_555
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 555 for ONNX tensor: 555
[11/24/2022-12:07:38] [V] [TRT] node_of_555 [Clip] outputs: [555 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_556 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 555
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_556 [Conv] inputs: [555 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.6.conv.1.0.weight -> (192, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_556 for ONNX node: node_of_556
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 556 for ONNX tensor: 556
[11/24/2022-12:07:38] [V] [TRT] node_of_556 [Conv] outputs: [556 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_557 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 556
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_557 [BatchNormalization] inputs: [556 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.6.conv.1.1.weight -> (192)[FLOAT]], [backbone.features.6.conv.1.1.bias -> (192)[FLOAT]], [backbone.features.6.conv.1.1.running_mean -> (192)[FLOAT]], [backbone.features.6.conv.1.1.running_var -> (192)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_557 for ONNX node: node_of_557
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 557 for ONNX tensor: 557
[11/24/2022-12:07:38] [V] [TRT] node_of_557 [BatchNormalization] outputs: [557 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_558 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 557
[11/24/2022-12:07:38] [V] [TRT] node_of_558 [Clip] inputs: [557 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_558 for ONNX node: node_of_558
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 558 for ONNX tensor: 558
[11/24/2022-12:07:38] [V] [TRT] node_of_558 [Clip] outputs: [558 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_559 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 558
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_559 [Conv] inputs: [558 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.6.conv.2.weight -> (32, 192, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_559 for ONNX node: node_of_559
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559
[11/24/2022-12:07:38] [V] [TRT] node_of_559 [Conv] outputs: [559 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_560 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 559
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.6.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_560 [BatchNormalization] inputs: [559 -> (1, 32, 44, 84)[FLOAT]], [backbone.features.6.conv.3.weight -> (32)[FLOAT]], [backbone.features.6.conv.3.bias -> (32)[FLOAT]], [backbone.features.6.conv.3.running_mean -> (32)[FLOAT]], [backbone.features.6.conv.3.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_560 for ONNX node: node_of_560
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 560 for ONNX tensor: 560
[11/24/2022-12:07:38] [V] [TRT] node_of_560 [BatchNormalization] outputs: [560 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_561 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 552
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 560
[11/24/2022-12:07:38] [V] [TRT] node_of_561 [Add] inputs: [552 -> (1, 32, 44, 84)[FLOAT]], [560 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_561 for ONNX node: node_of_561
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 561 for ONNX tensor: 561
[11/24/2022-12:07:38] [V] [TRT] node_of_561 [Add] outputs: [561 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_562 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 561
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_562 [Conv] inputs: [561 -> (1, 32, 44, 84)[FLOAT]], [backbone.features.7.conv.0.0.weight -> (192, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_562 for ONNX node: node_of_562
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 562 for ONNX tensor: 562
[11/24/2022-12:07:38] [V] [TRT] node_of_562 [Conv] outputs: [562 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_563 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 562
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_563 [BatchNormalization] inputs: [562 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.7.conv.0.1.weight -> (192)[FLOAT]], [backbone.features.7.conv.0.1.bias -> (192)[FLOAT]], [backbone.features.7.conv.0.1.running_mean -> (192)[FLOAT]], [backbone.features.7.conv.0.1.running_var -> (192)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_563 for ONNX node: node_of_563
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 563 for ONNX tensor: 563
[11/24/2022-12:07:38] [V] [TRT] node_of_563 [BatchNormalization] outputs: [563 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_564 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 563
[11/24/2022-12:07:38] [V] [TRT] node_of_564 [Clip] inputs: [563 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_564 for ONNX node: node_of_564
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 564 for ONNX tensor: 564
[11/24/2022-12:07:38] [V] [TRT] node_of_564 [Clip] outputs: [564 -> (1, 192, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_565 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 564
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_565 [Conv] inputs: [564 -> (1, 192, 44, 84)[FLOAT]], [backbone.features.7.conv.1.0.weight -> (192, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 192, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_565 for ONNX node: node_of_565
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 192, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 565 for ONNX tensor: 565
[11/24/2022-12:07:38] [V] [TRT] node_of_565 [Conv] outputs: [565 -> (1, 192, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_566 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 565
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_566 [BatchNormalization] inputs: [565 -> (1, 192, 22, 42)[FLOAT]], [backbone.features.7.conv.1.1.weight -> (192)[FLOAT]], [backbone.features.7.conv.1.1.bias -> (192)[FLOAT]], [backbone.features.7.conv.1.1.running_mean -> (192)[FLOAT]], [backbone.features.7.conv.1.1.running_var -> (192)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_566 for ONNX node: node_of_566
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 566 for ONNX tensor: 566
[11/24/2022-12:07:38] [V] [TRT] node_of_566 [BatchNormalization] outputs: [566 -> (1, 192, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_567 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 566
[11/24/2022-12:07:38] [V] [TRT] node_of_567 [Clip] inputs: [566 -> (1, 192, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_567 for ONNX node: node_of_567
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 567 for ONNX tensor: 567
[11/24/2022-12:07:38] [V] [TRT] node_of_567 [Clip] outputs: [567 -> (1, 192, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_568 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 567
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_568 [Conv] inputs: [567 -> (1, 192, 22, 42)[FLOAT]], [backbone.features.7.conv.2.weight -> (64, 192, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 192, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_568 for ONNX node: node_of_568
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 568 for ONNX tensor: 568
[11/24/2022-12:07:38] [V] [TRT] node_of_568 [Conv] outputs: [568 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_569 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 568
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.7.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_569 [BatchNormalization] inputs: [568 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.7.conv.3.weight -> (64)[FLOAT]], [backbone.features.7.conv.3.bias -> (64)[FLOAT]], [backbone.features.7.conv.3.running_mean -> (64)[FLOAT]], [backbone.features.7.conv.3.running_var -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_569 for ONNX node: node_of_569
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569
[11/24/2022-12:07:38] [V] [TRT] node_of_569 [BatchNormalization] outputs: [569 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_570 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 569
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_570 [Conv] inputs: [569 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.8.conv.0.0.weight -> (384, 64, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_570 for ONNX node: node_of_570
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570
[11/24/2022-12:07:38] [V] [TRT] node_of_570 [Conv] outputs: [570 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_571 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 570
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_571 [BatchNormalization] inputs: [570 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.8.conv.0.1.weight -> (384)[FLOAT]], [backbone.features.8.conv.0.1.bias -> (384)[FLOAT]], [backbone.features.8.conv.0.1.running_mean -> (384)[FLOAT]], [backbone.features.8.conv.0.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_571 for ONNX node: node_of_571
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 571 for ONNX tensor: 571
[11/24/2022-12:07:38] [V] [TRT] node_of_571 [BatchNormalization] outputs: [571 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_572 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 571
[11/24/2022-12:07:38] [V] [TRT] node_of_572 [Clip] inputs: [571 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_572 for ONNX node: node_of_572
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 572 for ONNX tensor: 572
[11/24/2022-12:07:38] [V] [TRT] node_of_572 [Clip] outputs: [572 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_573 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 572
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_573 [Conv] inputs: [572 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.8.conv.1.0.weight -> (384, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_573 for ONNX node: node_of_573
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 573 for ONNX tensor: 573
[11/24/2022-12:07:38] [V] [TRT] node_of_573 [Conv] outputs: [573 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_574 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 573
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_574 [BatchNormalization] inputs: [573 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.8.conv.1.1.weight -> (384)[FLOAT]], [backbone.features.8.conv.1.1.bias -> (384)[FLOAT]], [backbone.features.8.conv.1.1.running_mean -> (384)[FLOAT]], [backbone.features.8.conv.1.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_574 for ONNX node: node_of_574
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 574 for ONNX tensor: 574
[11/24/2022-12:07:38] [V] [TRT] node_of_574 [BatchNormalization] outputs: [574 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_575 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 574
[11/24/2022-12:07:38] [V] [TRT] node_of_575 [Clip] inputs: [574 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_575 for ONNX node: node_of_575
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 575 for ONNX tensor: 575
[11/24/2022-12:07:38] [V] [TRT] node_of_575 [Clip] outputs: [575 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_576 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 575
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_576 [Conv] inputs: [575 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.8.conv.2.weight -> (64, 384, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_576 for ONNX node: node_of_576
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576
[11/24/2022-12:07:38] [V] [TRT] node_of_576 [Conv] outputs: [576 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_577 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 576
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.8.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_577 [BatchNormalization] inputs: [576 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.8.conv.3.weight -> (64)[FLOAT]], [backbone.features.8.conv.3.bias -> (64)[FLOAT]], [backbone.features.8.conv.3.running_mean -> (64)[FLOAT]], [backbone.features.8.conv.3.running_var -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_577 for ONNX node: node_of_577
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 577 for ONNX tensor: 577
[11/24/2022-12:07:38] [V] [TRT] node_of_577 [BatchNormalization] outputs: [577 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_578 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 569
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 577
[11/24/2022-12:07:38] [V] [TRT] node_of_578 [Add] inputs: [569 -> (1, 64, 22, 42)[FLOAT]], [577 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_578 for ONNX node: node_of_578
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 578 for ONNX tensor: 578
[11/24/2022-12:07:38] [V] [TRT] node_of_578 [Add] outputs: [578 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_579 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 578
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_579 [Conv] inputs: [578 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.9.conv.0.0.weight -> (384, 64, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_579 for ONNX node: node_of_579
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 579 for ONNX tensor: 579
[11/24/2022-12:07:38] [V] [TRT] node_of_579 [Conv] outputs: [579 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_580 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 579
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_580 [BatchNormalization] inputs: [579 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.9.conv.0.1.weight -> (384)[FLOAT]], [backbone.features.9.conv.0.1.bias -> (384)[FLOAT]], [backbone.features.9.conv.0.1.running_mean -> (384)[FLOAT]], [backbone.features.9.conv.0.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_580 for ONNX node: node_of_580
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580
[11/24/2022-12:07:38] [V] [TRT] node_of_580 [BatchNormalization] outputs: [580 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_581 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 580
[11/24/2022-12:07:38] [V] [TRT] node_of_581 [Clip] inputs: [580 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_581 for ONNX node: node_of_581
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 581 for ONNX tensor: 581
[11/24/2022-12:07:38] [V] [TRT] node_of_581 [Clip] outputs: [581 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_582 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 581
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_582 [Conv] inputs: [581 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.9.conv.1.0.weight -> (384, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_582 for ONNX node: node_of_582
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 582 for ONNX tensor: 582
[11/24/2022-12:07:38] [V] [TRT] node_of_582 [Conv] outputs: [582 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_583 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 582
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_583 [BatchNormalization] inputs: [582 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.9.conv.1.1.weight -> (384)[FLOAT]], [backbone.features.9.conv.1.1.bias -> (384)[FLOAT]], [backbone.features.9.conv.1.1.running_mean -> (384)[FLOAT]], [backbone.features.9.conv.1.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_583 for ONNX node: node_of_583
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 583 for ONNX tensor: 583
[11/24/2022-12:07:38] [V] [TRT] node_of_583 [BatchNormalization] outputs: [583 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_584 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 583
[11/24/2022-12:07:38] [V] [TRT] node_of_584 [Clip] inputs: [583 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_584 for ONNX node: node_of_584
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584
[11/24/2022-12:07:38] [V] [TRT] node_of_584 [Clip] outputs: [584 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_585 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 584
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_585 [Conv] inputs: [584 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.9.conv.2.weight -> (64, 384, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_585 for ONNX node: node_of_585
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 585 for ONNX tensor: 585
[11/24/2022-12:07:38] [V] [TRT] node_of_585 [Conv] outputs: [585 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_586 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 585
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.9.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_586 [BatchNormalization] inputs: [585 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.9.conv.3.weight -> (64)[FLOAT]], [backbone.features.9.conv.3.bias -> (64)[FLOAT]], [backbone.features.9.conv.3.running_mean -> (64)[FLOAT]], [backbone.features.9.conv.3.running_var -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_586 for ONNX node: node_of_586
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 586 for ONNX tensor: 586
[11/24/2022-12:07:38] [V] [TRT] node_of_586 [BatchNormalization] outputs: [586 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_587 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 578
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 586
[11/24/2022-12:07:38] [V] [TRT] node_of_587 [Add] inputs: [578 -> (1, 64, 22, 42)[FLOAT]], [586 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_587 for ONNX node: node_of_587
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587
[11/24/2022-12:07:38] [V] [TRT] node_of_587 [Add] outputs: [587 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_588 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 587
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_588 [Conv] inputs: [587 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.10.conv.0.0.weight -> (384, 64, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_588 for ONNX node: node_of_588
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 588 for ONNX tensor: 588
[11/24/2022-12:07:38] [V] [TRT] node_of_588 [Conv] outputs: [588 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_589 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 588
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_589 [BatchNormalization] inputs: [588 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.10.conv.0.1.weight -> (384)[FLOAT]], [backbone.features.10.conv.0.1.bias -> (384)[FLOAT]], [backbone.features.10.conv.0.1.running_mean -> (384)[FLOAT]], [backbone.features.10.conv.0.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_589 for ONNX node: node_of_589
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 589 for ONNX tensor: 589
[11/24/2022-12:07:38] [V] [TRT] node_of_589 [BatchNormalization] outputs: [589 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_590 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 589
[11/24/2022-12:07:38] [V] [TRT] node_of_590 [Clip] inputs: [589 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_590 for ONNX node: node_of_590
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590
[11/24/2022-12:07:38] [V] [TRT] node_of_590 [Clip] outputs: [590 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_591 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 590
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_591 [Conv] inputs: [590 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.10.conv.1.0.weight -> (384, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_591 for ONNX node: node_of_591
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 591 for ONNX tensor: 591
[11/24/2022-12:07:38] [V] [TRT] node_of_591 [Conv] outputs: [591 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_592 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 591
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_592 [BatchNormalization] inputs: [591 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.10.conv.1.1.weight -> (384)[FLOAT]], [backbone.features.10.conv.1.1.bias -> (384)[FLOAT]], [backbone.features.10.conv.1.1.running_mean -> (384)[FLOAT]], [backbone.features.10.conv.1.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_592 for ONNX node: node_of_592
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 592 for ONNX tensor: 592
[11/24/2022-12:07:38] [V] [TRT] node_of_592 [BatchNormalization] outputs: [592 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_593 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 592
[11/24/2022-12:07:38] [V] [TRT] node_of_593 [Clip] inputs: [592 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_593 for ONNX node: node_of_593
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 593 for ONNX tensor: 593
[11/24/2022-12:07:38] [V] [TRT] node_of_593 [Clip] outputs: [593 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_594 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 593
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_594 [Conv] inputs: [593 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.10.conv.2.weight -> (64, 384, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_594 for ONNX node: node_of_594
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 594 for ONNX tensor: 594
[11/24/2022-12:07:38] [V] [TRT] node_of_594 [Conv] outputs: [594 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_595 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 594
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.10.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_595 [BatchNormalization] inputs: [594 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.10.conv.3.weight -> (64)[FLOAT]], [backbone.features.10.conv.3.bias -> (64)[FLOAT]], [backbone.features.10.conv.3.running_mean -> (64)[FLOAT]], [backbone.features.10.conv.3.running_var -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_595 for ONNX node: node_of_595
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 595 for ONNX tensor: 595
[11/24/2022-12:07:38] [V] [TRT] node_of_595 [BatchNormalization] outputs: [595 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_596 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 587
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 595
[11/24/2022-12:07:38] [V] [TRT] node_of_596 [Add] inputs: [587 -> (1, 64, 22, 42)[FLOAT]], [595 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_596 for ONNX node: node_of_596
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 596 for ONNX tensor: 596
[11/24/2022-12:07:38] [V] [TRT] node_of_596 [Add] outputs: [596 -> (1, 64, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_597 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 596
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_597 [Conv] inputs: [596 -> (1, 64, 22, 42)[FLOAT]], [backbone.features.11.conv.0.0.weight -> (384, 64, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_597 for ONNX node: node_of_597
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 597 for ONNX tensor: 597
[11/24/2022-12:07:38] [V] [TRT] node_of_597 [Conv] outputs: [597 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_598 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 597
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_598 [BatchNormalization] inputs: [597 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.11.conv.0.1.weight -> (384)[FLOAT]], [backbone.features.11.conv.0.1.bias -> (384)[FLOAT]], [backbone.features.11.conv.0.1.running_mean -> (384)[FLOAT]], [backbone.features.11.conv.0.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_598 for ONNX node: node_of_598
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 598 for ONNX tensor: 598
[11/24/2022-12:07:38] [V] [TRT] node_of_598 [BatchNormalization] outputs: [598 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_599 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 598
[11/24/2022-12:07:38] [V] [TRT] node_of_599 [Clip] inputs: [598 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_599 for ONNX node: node_of_599
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 599 for ONNX tensor: 599
[11/24/2022-12:07:38] [V] [TRT] node_of_599 [Clip] outputs: [599 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_600 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 599
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_600 [Conv] inputs: [599 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.11.conv.1.0.weight -> (384, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_600 for ONNX node: node_of_600
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 600 for ONNX tensor: 600
[11/24/2022-12:07:38] [V] [TRT] node_of_600 [Conv] outputs: [600 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_601 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 600
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_601 [BatchNormalization] inputs: [600 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.11.conv.1.1.weight -> (384)[FLOAT]], [backbone.features.11.conv.1.1.bias -> (384)[FLOAT]], [backbone.features.11.conv.1.1.running_mean -> (384)[FLOAT]], [backbone.features.11.conv.1.1.running_var -> (384)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_601 for ONNX node: node_of_601
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 601 for ONNX tensor: 601
[11/24/2022-12:07:38] [V] [TRT] node_of_601 [BatchNormalization] outputs: [601 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_602 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 601
[11/24/2022-12:07:38] [V] [TRT] node_of_602 [Clip] inputs: [601 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_602 for ONNX node: node_of_602
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 602 for ONNX tensor: 602
[11/24/2022-12:07:38] [V] [TRT] node_of_602 [Clip] outputs: [602 -> (1, 384, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_603 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 602
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_603 [Conv] inputs: [602 -> (1, 384, 22, 42)[FLOAT]], [backbone.features.11.conv.2.weight -> (96, 384, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 384, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_603 for ONNX node: node_of_603
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 603 for ONNX tensor: 603
[11/24/2022-12:07:38] [V] [TRT] node_of_603 [Conv] outputs: [603 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_604 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 603
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.11.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_604 [BatchNormalization] inputs: [603 -> (1, 96, 22, 42)[FLOAT]], [backbone.features.11.conv.3.weight -> (96)[FLOAT]], [backbone.features.11.conv.3.bias -> (96)[FLOAT]], [backbone.features.11.conv.3.running_mean -> (96)[FLOAT]], [backbone.features.11.conv.3.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_604 for ONNX node: node_of_604
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 604 for ONNX tensor: 604
[11/24/2022-12:07:38] [V] [TRT] node_of_604 [BatchNormalization] outputs: [604 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_605 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 604
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_605 [Conv] inputs: [604 -> (1, 96, 22, 42)[FLOAT]], [backbone.features.12.conv.0.0.weight -> (576, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_605 for ONNX node: node_of_605
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 576
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 605 for ONNX tensor: 605
[11/24/2022-12:07:38] [V] [TRT] node_of_605 [Conv] outputs: [605 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_606 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 605
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_606 [BatchNormalization] inputs: [605 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.12.conv.0.1.weight -> (576)[FLOAT]], [backbone.features.12.conv.0.1.bias -> (576)[FLOAT]], [backbone.features.12.conv.0.1.running_mean -> (576)[FLOAT]], [backbone.features.12.conv.0.1.running_var -> (576)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_606 for ONNX node: node_of_606
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 606 for ONNX tensor: 606
[11/24/2022-12:07:38] [V] [TRT] node_of_606 [BatchNormalization] outputs: [606 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_607 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 606
[11/24/2022-12:07:38] [V] [TRT] node_of_607 [Clip] inputs: [606 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_607 for ONNX node: node_of_607
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 607 for ONNX tensor: 607
[11/24/2022-12:07:38] [V] [TRT] node_of_607 [Clip] outputs: [607 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_608 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 607
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_608 [Conv] inputs: [607 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.12.conv.1.0.weight -> (576, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_608 for ONNX node: node_of_608
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 576
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608
[11/24/2022-12:07:38] [V] [TRT] node_of_608 [Conv] outputs: [608 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_609 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 608
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_609 [BatchNormalization] inputs: [608 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.12.conv.1.1.weight -> (576)[FLOAT]], [backbone.features.12.conv.1.1.bias -> (576)[FLOAT]], [backbone.features.12.conv.1.1.running_mean -> (576)[FLOAT]], [backbone.features.12.conv.1.1.running_var -> (576)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_609 for ONNX node: node_of_609
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609
[11/24/2022-12:07:38] [V] [TRT] node_of_609 [BatchNormalization] outputs: [609 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_610 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 609
[11/24/2022-12:07:38] [V] [TRT] node_of_610 [Clip] inputs: [609 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_610 for ONNX node: node_of_610
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 610 for ONNX tensor: 610
[11/24/2022-12:07:38] [V] [TRT] node_of_610 [Clip] outputs: [610 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_611 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 610
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_611 [Conv] inputs: [610 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.12.conv.2.weight -> (96, 576, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_611 for ONNX node: node_of_611
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 611 for ONNX tensor: 611
[11/24/2022-12:07:38] [V] [TRT] node_of_611 [Conv] outputs: [611 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_612 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 611
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.12.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_612 [BatchNormalization] inputs: [611 -> (1, 96, 22, 42)[FLOAT]], [backbone.features.12.conv.3.weight -> (96)[FLOAT]], [backbone.features.12.conv.3.bias -> (96)[FLOAT]], [backbone.features.12.conv.3.running_mean -> (96)[FLOAT]], [backbone.features.12.conv.3.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_612 for ONNX node: node_of_612
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 612 for ONNX tensor: 612
[11/24/2022-12:07:38] [V] [TRT] node_of_612 [BatchNormalization] outputs: [612 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_613 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 604
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 612
[11/24/2022-12:07:38] [V] [TRT] node_of_613 [Add] inputs: [604 -> (1, 96, 22, 42)[FLOAT]], [612 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_613 for ONNX node: node_of_613
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613
[11/24/2022-12:07:38] [V] [TRT] node_of_613 [Add] outputs: [613 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_614 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 613
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_614 [Conv] inputs: [613 -> (1, 96, 22, 42)[FLOAT]], [backbone.features.13.conv.0.0.weight -> (576, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_614 for ONNX node: node_of_614
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 576
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 614 for ONNX tensor: 614
[11/24/2022-12:07:38] [V] [TRT] node_of_614 [Conv] outputs: [614 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_615 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 614
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_615 [BatchNormalization] inputs: [614 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.13.conv.0.1.weight -> (576)[FLOAT]], [backbone.features.13.conv.0.1.bias -> (576)[FLOAT]], [backbone.features.13.conv.0.1.running_mean -> (576)[FLOAT]], [backbone.features.13.conv.0.1.running_var -> (576)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_615 for ONNX node: node_of_615
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615
[11/24/2022-12:07:38] [V] [TRT] node_of_615 [BatchNormalization] outputs: [615 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_616 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 615
[11/24/2022-12:07:38] [V] [TRT] node_of_616 [Clip] inputs: [615 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_616 for ONNX node: node_of_616
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 616 for ONNX tensor: 616
[11/24/2022-12:07:38] [V] [TRT] node_of_616 [Clip] outputs: [616 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_617 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 616
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_617 [Conv] inputs: [616 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.13.conv.1.0.weight -> (576, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_617 for ONNX node: node_of_617
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 576
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 617 for ONNX tensor: 617
[11/24/2022-12:07:38] [V] [TRT] node_of_617 [Conv] outputs: [617 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_618 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 617
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_618 [BatchNormalization] inputs: [617 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.13.conv.1.1.weight -> (576)[FLOAT]], [backbone.features.13.conv.1.1.bias -> (576)[FLOAT]], [backbone.features.13.conv.1.1.running_mean -> (576)[FLOAT]], [backbone.features.13.conv.1.1.running_var -> (576)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_618 for ONNX node: node_of_618
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 618 for ONNX tensor: 618
[11/24/2022-12:07:38] [V] [TRT] node_of_618 [BatchNormalization] outputs: [618 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_619 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 618
[11/24/2022-12:07:38] [V] [TRT] node_of_619 [Clip] inputs: [618 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_619 for ONNX node: node_of_619
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 619 for ONNX tensor: 619
[11/24/2022-12:07:38] [V] [TRT] node_of_619 [Clip] outputs: [619 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_620 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 619
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_620 [Conv] inputs: [619 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.13.conv.2.weight -> (96, 576, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_620 for ONNX node: node_of_620
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 620 for ONNX tensor: 620
[11/24/2022-12:07:38] [V] [TRT] node_of_620 [Conv] outputs: [620 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_621 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 620
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.13.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_621 [BatchNormalization] inputs: [620 -> (1, 96, 22, 42)[FLOAT]], [backbone.features.13.conv.3.weight -> (96)[FLOAT]], [backbone.features.13.conv.3.bias -> (96)[FLOAT]], [backbone.features.13.conv.3.running_mean -> (96)[FLOAT]], [backbone.features.13.conv.3.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_621 for ONNX node: node_of_621
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621
[11/24/2022-12:07:38] [V] [TRT] node_of_621 [BatchNormalization] outputs: [621 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_622 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 613
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 621
[11/24/2022-12:07:38] [V] [TRT] node_of_622 [Add] inputs: [613 -> (1, 96, 22, 42)[FLOAT]], [621 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_622 for ONNX node: node_of_622
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 622 for ONNX tensor: 622
[11/24/2022-12:07:38] [V] [TRT] node_of_622 [Add] outputs: [622 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_623 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 622
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_623 [Conv] inputs: [622 -> (1, 96, 22, 42)[FLOAT]], [backbone.features.14.conv.0.0.weight -> (576, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_623 for ONNX node: node_of_623
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 576
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 623 for ONNX tensor: 623
[11/24/2022-12:07:38] [V] [TRT] node_of_623 [Conv] outputs: [623 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_624 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 623
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_624 [BatchNormalization] inputs: [623 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.14.conv.0.1.weight -> (576)[FLOAT]], [backbone.features.14.conv.0.1.bias -> (576)[FLOAT]], [backbone.features.14.conv.0.1.running_mean -> (576)[FLOAT]], [backbone.features.14.conv.0.1.running_var -> (576)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_624 for ONNX node: node_of_624
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 624 for ONNX tensor: 624
[11/24/2022-12:07:38] [V] [TRT] node_of_624 [BatchNormalization] outputs: [624 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_625 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 624
[11/24/2022-12:07:38] [V] [TRT] node_of_625 [Clip] inputs: [624 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_625 for ONNX node: node_of_625
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 625 for ONNX tensor: 625
[11/24/2022-12:07:38] [V] [TRT] node_of_625 [Clip] outputs: [625 -> (1, 576, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_626 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 625
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_626 [Conv] inputs: [625 -> (1, 576, 22, 42)[FLOAT]], [backbone.features.14.conv.1.0.weight -> (576, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 576, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_626 for ONNX node: node_of_626
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 576
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 576, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 626 for ONNX tensor: 626
[11/24/2022-12:07:38] [V] [TRT] node_of_626 [Conv] outputs: [626 -> (1, 576, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_627 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 626
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_627 [BatchNormalization] inputs: [626 -> (1, 576, 11, 21)[FLOAT]], [backbone.features.14.conv.1.1.weight -> (576)[FLOAT]], [backbone.features.14.conv.1.1.bias -> (576)[FLOAT]], [backbone.features.14.conv.1.1.running_mean -> (576)[FLOAT]], [backbone.features.14.conv.1.1.running_var -> (576)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_627 for ONNX node: node_of_627
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 627 for ONNX tensor: 627
[11/24/2022-12:07:38] [V] [TRT] node_of_627 [BatchNormalization] outputs: [627 -> (1, 576, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_628 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 627
[11/24/2022-12:07:38] [V] [TRT] node_of_628 [Clip] inputs: [627 -> (1, 576, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_628 for ONNX node: node_of_628
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628
[11/24/2022-12:07:38] [V] [TRT] node_of_628 [Clip] outputs: [628 -> (1, 576, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_629 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 628
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_629 [Conv] inputs: [628 -> (1, 576, 11, 21)[FLOAT]], [backbone.features.14.conv.2.weight -> (160, 576, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 576, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_629 for ONNX node: node_of_629
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 160, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629
[11/24/2022-12:07:38] [V] [TRT] node_of_629 [Conv] outputs: [629 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_630 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 629
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.14.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_630 [BatchNormalization] inputs: [629 -> (1, 160, 11, 21)[FLOAT]], [backbone.features.14.conv.3.weight -> (160)[FLOAT]], [backbone.features.14.conv.3.bias -> (160)[FLOAT]], [backbone.features.14.conv.3.running_mean -> (160)[FLOAT]], [backbone.features.14.conv.3.running_var -> (160)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_630 for ONNX node: node_of_630
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 630 for ONNX tensor: 630
[11/24/2022-12:07:38] [V] [TRT] node_of_630 [BatchNormalization] outputs: [630 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_631 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 630
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_631 [Conv] inputs: [630 -> (1, 160, 11, 21)[FLOAT]], [backbone.features.15.conv.0.0.weight -> (960, 160, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 160, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_631 for ONNX node: node_of_631
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 631 for ONNX tensor: 631
[11/24/2022-12:07:38] [V] [TRT] node_of_631 [Conv] outputs: [631 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_632 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 631
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_632 [BatchNormalization] inputs: [631 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.15.conv.0.1.weight -> (960)[FLOAT]], [backbone.features.15.conv.0.1.bias -> (960)[FLOAT]], [backbone.features.15.conv.0.1.running_mean -> (960)[FLOAT]], [backbone.features.15.conv.0.1.running_var -> (960)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_632 for ONNX node: node_of_632
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 632 for ONNX tensor: 632
[11/24/2022-12:07:38] [V] [TRT] node_of_632 [BatchNormalization] outputs: [632 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_633 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 632
[11/24/2022-12:07:38] [V] [TRT] node_of_633 [Clip] inputs: [632 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_633 for ONNX node: node_of_633
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 633 for ONNX tensor: 633
[11/24/2022-12:07:38] [V] [TRT] node_of_633 [Clip] outputs: [633 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_634 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 633
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_634 [Conv] inputs: [633 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.15.conv.1.0.weight -> (960, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_634 for ONNX node: node_of_634
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 960
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 634 for ONNX tensor: 634
[11/24/2022-12:07:38] [V] [TRT] node_of_634 [Conv] outputs: [634 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_635 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 634
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_635 [BatchNormalization] inputs: [634 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.15.conv.1.1.weight -> (960)[FLOAT]], [backbone.features.15.conv.1.1.bias -> (960)[FLOAT]], [backbone.features.15.conv.1.1.running_mean -> (960)[FLOAT]], [backbone.features.15.conv.1.1.running_var -> (960)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_635 for ONNX node: node_of_635
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 635 for ONNX tensor: 635
[11/24/2022-12:07:38] [V] [TRT] node_of_635 [BatchNormalization] outputs: [635 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_636 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 635
[11/24/2022-12:07:38] [V] [TRT] node_of_636 [Clip] inputs: [635 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_636 for ONNX node: node_of_636
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 636 for ONNX tensor: 636
[11/24/2022-12:07:38] [V] [TRT] node_of_636 [Clip] outputs: [636 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_637 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 636
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_637 [Conv] inputs: [636 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.15.conv.2.weight -> (160, 960, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_637 for ONNX node: node_of_637
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 160, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637
[11/24/2022-12:07:38] [V] [TRT] node_of_637 [Conv] outputs: [637 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_638 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 637
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.15.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_638 [BatchNormalization] inputs: [637 -> (1, 160, 11, 21)[FLOAT]], [backbone.features.15.conv.3.weight -> (160)[FLOAT]], [backbone.features.15.conv.3.bias -> (160)[FLOAT]], [backbone.features.15.conv.3.running_mean -> (160)[FLOAT]], [backbone.features.15.conv.3.running_var -> (160)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_638 for ONNX node: node_of_638
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 638 for ONNX tensor: 638
[11/24/2022-12:07:38] [V] [TRT] node_of_638 [BatchNormalization] outputs: [638 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_639 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 630
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 638
[11/24/2022-12:07:38] [V] [TRT] node_of_639 [Add] inputs: [630 -> (1, 160, 11, 21)[FLOAT]], [638 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_639 for ONNX node: node_of_639
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 639 for ONNX tensor: 639
[11/24/2022-12:07:38] [V] [TRT] node_of_639 [Add] outputs: [639 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_640 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 639
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_640 [Conv] inputs: [639 -> (1, 160, 11, 21)[FLOAT]], [backbone.features.16.conv.0.0.weight -> (960, 160, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 160, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_640 for ONNX node: node_of_640
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640
[11/24/2022-12:07:38] [V] [TRT] node_of_640 [Conv] outputs: [640 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_641 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 640
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_641 [BatchNormalization] inputs: [640 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.16.conv.0.1.weight -> (960)[FLOAT]], [backbone.features.16.conv.0.1.bias -> (960)[FLOAT]], [backbone.features.16.conv.0.1.running_mean -> (960)[FLOAT]], [backbone.features.16.conv.0.1.running_var -> (960)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_641 for ONNX node: node_of_641
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 641 for ONNX tensor: 641
[11/24/2022-12:07:38] [V] [TRT] node_of_641 [BatchNormalization] outputs: [641 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_642 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 641
[11/24/2022-12:07:38] [V] [TRT] node_of_642 [Clip] inputs: [641 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_642 for ONNX node: node_of_642
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642
[11/24/2022-12:07:38] [V] [TRT] node_of_642 [Clip] outputs: [642 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_643 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 642
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_643 [Conv] inputs: [642 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.16.conv.1.0.weight -> (960, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_643 for ONNX node: node_of_643
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 960
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643
[11/24/2022-12:07:38] [V] [TRT] node_of_643 [Conv] outputs: [643 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_644 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 643
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_644 [BatchNormalization] inputs: [643 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.16.conv.1.1.weight -> (960)[FLOAT]], [backbone.features.16.conv.1.1.bias -> (960)[FLOAT]], [backbone.features.16.conv.1.1.running_mean -> (960)[FLOAT]], [backbone.features.16.conv.1.1.running_var -> (960)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_644 for ONNX node: node_of_644
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 644 for ONNX tensor: 644
[11/24/2022-12:07:38] [V] [TRT] node_of_644 [BatchNormalization] outputs: [644 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_645 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 644
[11/24/2022-12:07:38] [V] [TRT] node_of_645 [Clip] inputs: [644 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_645 for ONNX node: node_of_645
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 645 for ONNX tensor: 645
[11/24/2022-12:07:38] [V] [TRT] node_of_645 [Clip] outputs: [645 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_646 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 645
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_646 [Conv] inputs: [645 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.16.conv.2.weight -> (160, 960, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_646 for ONNX node: node_of_646
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 160, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646
[11/24/2022-12:07:38] [V] [TRT] node_of_646 [Conv] outputs: [646 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_647 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 646
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.16.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_647 [BatchNormalization] inputs: [646 -> (1, 160, 11, 21)[FLOAT]], [backbone.features.16.conv.3.weight -> (160)[FLOAT]], [backbone.features.16.conv.3.bias -> (160)[FLOAT]], [backbone.features.16.conv.3.running_mean -> (160)[FLOAT]], [backbone.features.16.conv.3.running_var -> (160)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_647 for ONNX node: node_of_647
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647
[11/24/2022-12:07:38] [V] [TRT] node_of_647 [BatchNormalization] outputs: [647 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_648 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 639
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 647
[11/24/2022-12:07:38] [V] [TRT] node_of_648 [Add] inputs: [639 -> (1, 160, 11, 21)[FLOAT]], [647 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_648 for ONNX node: node_of_648
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 648 for ONNX tensor: 648
[11/24/2022-12:07:38] [V] [TRT] node_of_648 [Add] outputs: [648 -> (1, 160, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_649 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 648
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.0.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_649 [Conv] inputs: [648 -> (1, 160, 11, 21)[FLOAT]], [backbone.features.17.conv.0.0.weight -> (960, 160, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 160, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_649 for ONNX node: node_of_649
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 649 for ONNX tensor: 649
[11/24/2022-12:07:38] [V] [TRT] node_of_649 [Conv] outputs: [649 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_650 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 649
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.0.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.0.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.0.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.0.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_650 [BatchNormalization] inputs: [649 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.17.conv.0.1.weight -> (960)[FLOAT]], [backbone.features.17.conv.0.1.bias -> (960)[FLOAT]], [backbone.features.17.conv.0.1.running_mean -> (960)[FLOAT]], [backbone.features.17.conv.0.1.running_var -> (960)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_650 for ONNX node: node_of_650
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 650 for ONNX tensor: 650
[11/24/2022-12:07:38] [V] [TRT] node_of_650 [BatchNormalization] outputs: [650 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_651 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 650
[11/24/2022-12:07:38] [V] [TRT] node_of_651 [Clip] inputs: [650 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_651 for ONNX node: node_of_651
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 651 for ONNX tensor: 651
[11/24/2022-12:07:38] [V] [TRT] node_of_651 [Clip] outputs: [651 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_652 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 651
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.1.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_652 [Conv] inputs: [651 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.17.conv.1.0.weight -> (960, 1, 3, 3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_652 for ONNX node: node_of_652
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 960
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 652 for ONNX tensor: 652
[11/24/2022-12:07:38] [V] [TRT] node_of_652 [Conv] outputs: [652 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_653 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 652
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.1.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.1.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.1.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.1.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_653 [BatchNormalization] inputs: [652 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.17.conv.1.1.weight -> (960)[FLOAT]], [backbone.features.17.conv.1.1.bias -> (960)[FLOAT]], [backbone.features.17.conv.1.1.running_mean -> (960)[FLOAT]], [backbone.features.17.conv.1.1.running_var -> (960)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_653 for ONNX node: node_of_653
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 653 for ONNX tensor: 653
[11/24/2022-12:07:38] [V] [TRT] node_of_653 [BatchNormalization] outputs: [653 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_654 [Clip]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 653
[11/24/2022-12:07:38] [V] [TRT] node_of_654 [Clip] inputs: [653 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_654 for ONNX node: node_of_654
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 654 for ONNX tensor: 654
[11/24/2022-12:07:38] [V] [TRT] node_of_654 [Clip] outputs: [654 -> (1, 960, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_655 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 654
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_655 [Conv] inputs: [654 -> (1, 960, 11, 21)[FLOAT]], [backbone.features.17.conv.2.weight -> (320, 960, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 960, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_655 for ONNX node: node_of_655
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 320, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 655 for ONNX tensor: 655
[11/24/2022-12:07:38] [V] [TRT] node_of_655 [Conv] outputs: [655 -> (1, 320, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_656 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 655
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.3.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.3.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.3.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: backbone.features.17.conv.3.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_656 [BatchNormalization] inputs: [655 -> (1, 320, 11, 21)[FLOAT]], [backbone.features.17.conv.3.weight -> (320)[FLOAT]], [backbone.features.17.conv.3.bias -> (320)[FLOAT]], [backbone.features.17.conv.3.running_mean -> (320)[FLOAT]], [backbone.features.17.conv.3.running_var -> (320)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_656 for ONNX node: node_of_656
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 656 for ONNX tensor: 656
[11/24/2022-12:07:38] [V] [TRT] node_of_656 [BatchNormalization] outputs: [656 -> (1, 320, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_657 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 656
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_657 [Conv] inputs: [656 -> (1, 320, 11, 21)[FLOAT]], [neck.dla_up.ida_0.proj_1.conv.0.weight -> (96, 320, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 320, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_657 for ONNX node: node_of_657
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 11, 21)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657
[11/24/2022-12:07:38] [V] [TRT] node_of_657 [Conv] outputs: [657 -> (1, 96, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_658 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 657
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_658 [BatchNormalization] inputs: [657 -> (1, 96, 11, 21)[FLOAT]], [neck.dla_up.ida_0.proj_1.conv.1.weight -> (96)[FLOAT]], [neck.dla_up.ida_0.proj_1.conv.1.bias -> (96)[FLOAT]], [neck.dla_up.ida_0.proj_1.conv.1.running_mean -> (96)[FLOAT]], [neck.dla_up.ida_0.proj_1.conv.1.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_658 for ONNX node: node_of_658
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 658 for ONNX tensor: 658
[11/24/2022-12:07:38] [V] [TRT] node_of_658 [BatchNormalization] outputs: [658 -> (1, 96, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_659 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 658
[11/24/2022-12:07:38] [V] [TRT] node_of_659 [Relu] inputs: [658 -> (1, 96, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_659 for ONNX node: node_of_659
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 659 for ONNX tensor: 659
[11/24/2022-12:07:38] [V] [TRT] node_of_659 [Relu] outputs: [659 -> (1, 96, 11, 21)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_660 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 659
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_660 [ConvTranspose] inputs: [659 -> (1, 96, 11, 21)[FLOAT]], [neck.dla_up.ida_0.up_1.weight -> (96, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_660 for ONNX node: node_of_660
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 660 for ONNX tensor: 660
[11/24/2022-12:07:38] [V] [TRT] node_of_660 [ConvTranspose] outputs: [660 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_661 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 660
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 622
[11/24/2022-12:07:38] [V] [TRT] node_of_661 [Add] inputs: [660 -> (1, 96, 22, 42)[FLOAT]], [622 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_661 for ONNX node: node_of_661
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 661 for ONNX tensor: 661
[11/24/2022-12:07:38] [V] [TRT] node_of_661 [Add] outputs: [661 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_662 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 661
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_662 [Conv] inputs: [661 -> (1, 96, 22, 42)[FLOAT]], [neck.dla_up.ida_0.node_1.conv.0.weight -> (96, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_662 for ONNX node: node_of_662
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 662 for ONNX tensor: 662
[11/24/2022-12:07:38] [V] [TRT] node_of_662 [Conv] outputs: [662 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_663 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 662
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_0.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_663 [BatchNormalization] inputs: [662 -> (1, 96, 22, 42)[FLOAT]], [neck.dla_up.ida_0.node_1.conv.1.weight -> (96)[FLOAT]], [neck.dla_up.ida_0.node_1.conv.1.bias -> (96)[FLOAT]], [neck.dla_up.ida_0.node_1.conv.1.running_mean -> (96)[FLOAT]], [neck.dla_up.ida_0.node_1.conv.1.running_var -> (96)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_663 for ONNX node: node_of_663
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 663 for ONNX tensor: 663
[11/24/2022-12:07:38] [V] [TRT] node_of_663 [BatchNormalization] outputs: [663 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_664 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 663
[11/24/2022-12:07:38] [V] [TRT] node_of_664 [Relu] inputs: [663 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_664 for ONNX node: node_of_664
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 664 for ONNX tensor: 664
[11/24/2022-12:07:38] [V] [TRT] node_of_664 [Relu] outputs: [664 -> (1, 96, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_665 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 622
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_665 [Conv] inputs: [622 -> (1, 96, 22, 42)[FLOAT]], [neck.dla_up.ida_1.proj_1.conv.0.weight -> (32, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_665 for ONNX node: node_of_665
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 665 for ONNX tensor: 665
[11/24/2022-12:07:38] [V] [TRT] node_of_665 [Conv] outputs: [665 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_666 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 665
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_666 [BatchNormalization] inputs: [665 -> (1, 32, 22, 42)[FLOAT]], [neck.dla_up.ida_1.proj_1.conv.1.weight -> (32)[FLOAT]], [neck.dla_up.ida_1.proj_1.conv.1.bias -> (32)[FLOAT]], [neck.dla_up.ida_1.proj_1.conv.1.running_mean -> (32)[FLOAT]], [neck.dla_up.ida_1.proj_1.conv.1.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_666 for ONNX node: node_of_666
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 666 for ONNX tensor: 666
[11/24/2022-12:07:38] [V] [TRT] node_of_666 [BatchNormalization] outputs: [666 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_667 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 666
[11/24/2022-12:07:38] [V] [TRT] node_of_667 [Relu] inputs: [666 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_667 for ONNX node: node_of_667
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 667 for ONNX tensor: 667
[11/24/2022-12:07:38] [V] [TRT] node_of_667 [Relu] outputs: [667 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_668 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 667
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_668 [ConvTranspose] inputs: [667 -> (1, 32, 22, 42)[FLOAT]], [neck.dla_up.ida_1.up_1.weight -> (32, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_668 for ONNX node: node_of_668
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 668 for ONNX tensor: 668
[11/24/2022-12:07:38] [V] [TRT] node_of_668 [ConvTranspose] outputs: [668 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_669 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 668
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 561
[11/24/2022-12:07:38] [V] [TRT] node_of_669 [Add] inputs: [668 -> (1, 32, 44, 84)[FLOAT]], [561 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_669 for ONNX node: node_of_669
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 669 for ONNX tensor: 669
[11/24/2022-12:07:38] [V] [TRT] node_of_669 [Add] outputs: [669 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_670 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 669
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_670 [Conv] inputs: [669 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_1.node_1.conv.0.weight -> (32, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_670 for ONNX node: node_of_670
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 670 for ONNX tensor: 670
[11/24/2022-12:07:38] [V] [TRT] node_of_670 [Conv] outputs: [670 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_671 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 670
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_671 [BatchNormalization] inputs: [670 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_1.node_1.conv.1.weight -> (32)[FLOAT]], [neck.dla_up.ida_1.node_1.conv.1.bias -> (32)[FLOAT]], [neck.dla_up.ida_1.node_1.conv.1.running_mean -> (32)[FLOAT]], [neck.dla_up.ida_1.node_1.conv.1.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_671 for ONNX node: node_of_671
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 671 for ONNX tensor: 671
[11/24/2022-12:07:38] [V] [TRT] node_of_671 [BatchNormalization] outputs: [671 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_672 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 671
[11/24/2022-12:07:38] [V] [TRT] node_of_672 [Relu] inputs: [671 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_672 for ONNX node: node_of_672
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 672 for ONNX tensor: 672
[11/24/2022-12:07:38] [V] [TRT] node_of_672 [Relu] outputs: [672 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_673 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 664
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_673 [Conv] inputs: [664 -> (1, 96, 22, 42)[FLOAT]], [neck.dla_up.ida_1.proj_2.conv.0.weight -> (32, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_673 for ONNX node: node_of_673
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673
[11/24/2022-12:07:38] [V] [TRT] node_of_673 [Conv] outputs: [673 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_674 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 673
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.proj_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_674 [BatchNormalization] inputs: [673 -> (1, 32, 22, 42)[FLOAT]], [neck.dla_up.ida_1.proj_2.conv.1.weight -> (32)[FLOAT]], [neck.dla_up.ida_1.proj_2.conv.1.bias -> (32)[FLOAT]], [neck.dla_up.ida_1.proj_2.conv.1.running_mean -> (32)[FLOAT]], [neck.dla_up.ida_1.proj_2.conv.1.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_674 for ONNX node: node_of_674
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 674 for ONNX tensor: 674
[11/24/2022-12:07:38] [V] [TRT] node_of_674 [BatchNormalization] outputs: [674 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_675 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 674
[11/24/2022-12:07:38] [V] [TRT] node_of_675 [Relu] inputs: [674 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_675 for ONNX node: node_of_675
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 675 for ONNX tensor: 675
[11/24/2022-12:07:38] [V] [TRT] node_of_675 [Relu] outputs: [675 -> (1, 32, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_676 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 675
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.up_2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_676 [ConvTranspose] inputs: [675 -> (1, 32, 22, 42)[FLOAT]], [neck.dla_up.ida_1.up_2.weight -> (32, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_676 for ONNX node: node_of_676
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 676 for ONNX tensor: 676
[11/24/2022-12:07:38] [V] [TRT] node_of_676 [ConvTranspose] outputs: [676 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_677 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 676
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 672
[11/24/2022-12:07:38] [V] [TRT] node_of_677 [Add] inputs: [676 -> (1, 32, 44, 84)[FLOAT]], [672 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_677 for ONNX node: node_of_677
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 677 for ONNX tensor: 677
[11/24/2022-12:07:38] [V] [TRT] node_of_677 [Add] outputs: [677 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_678 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 677
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_678 [Conv] inputs: [677 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_1.node_2.conv.0.weight -> (32, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_678 for ONNX node: node_of_678
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 678 for ONNX tensor: 678
[11/24/2022-12:07:38] [V] [TRT] node_of_678 [Conv] outputs: [678 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_679 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 678
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_1.node_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_679 [BatchNormalization] inputs: [678 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_1.node_2.conv.1.weight -> (32)[FLOAT]], [neck.dla_up.ida_1.node_2.conv.1.bias -> (32)[FLOAT]], [neck.dla_up.ida_1.node_2.conv.1.running_mean -> (32)[FLOAT]], [neck.dla_up.ida_1.node_2.conv.1.running_var -> (32)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_679 for ONNX node: node_of_679
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 679 for ONNX tensor: 679
[11/24/2022-12:07:38] [V] [TRT] node_of_679 [BatchNormalization] outputs: [679 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_680 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 679
[11/24/2022-12:07:38] [V] [TRT] node_of_680 [Relu] inputs: [679 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_680 for ONNX node: node_of_680
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 680 for ONNX tensor: 680
[11/24/2022-12:07:38] [V] [TRT] node_of_680 [Relu] outputs: [680 -> (1, 32, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_681 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 561
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_681 [Conv] inputs: [561 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_2.proj_1.conv.0.weight -> (24, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_681 for ONNX node: node_of_681
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 681 for ONNX tensor: 681
[11/24/2022-12:07:38] [V] [TRT] node_of_681 [Conv] outputs: [681 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_682 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 681
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_682 [BatchNormalization] inputs: [681 -> (1, 24, 44, 84)[FLOAT]], [neck.dla_up.ida_2.proj_1.conv.1.weight -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_1.conv.1.bias -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_1.conv.1.running_mean -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_1.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_682 for ONNX node: node_of_682
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 682 for ONNX tensor: 682
[11/24/2022-12:07:38] [V] [TRT] node_of_682 [BatchNormalization] outputs: [682 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_683 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 682
[11/24/2022-12:07:38] [V] [TRT] node_of_683 [Relu] inputs: [682 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_683 for ONNX node: node_of_683
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 683 for ONNX tensor: 683
[11/24/2022-12:07:38] [V] [TRT] node_of_683 [Relu] outputs: [683 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_684 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 683
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_684 [ConvTranspose] inputs: [683 -> (1, 24, 44, 84)[FLOAT]], [neck.dla_up.ida_2.up_1.weight -> (24, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_684 for ONNX node: node_of_684
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 684 for ONNX tensor: 684
[11/24/2022-12:07:38] [V] [TRT] node_of_684 [ConvTranspose] outputs: [684 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_685 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 684
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 535
[11/24/2022-12:07:38] [V] [TRT] node_of_685 [Add] inputs: [684 -> (1, 24, 88, 168)[FLOAT]], [535 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_685 for ONNX node: node_of_685
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 685 for ONNX tensor: 685
[11/24/2022-12:07:38] [V] [TRT] node_of_685 [Add] outputs: [685 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_686 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 685
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_686 [Conv] inputs: [685 -> (1, 24, 88, 168)[FLOAT]], [neck.dla_up.ida_2.node_1.conv.0.weight -> (24, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_686 for ONNX node: node_of_686
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 686 for ONNX tensor: 686
[11/24/2022-12:07:38] [V] [TRT] node_of_686 [Conv] outputs: [686 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_687 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 686
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_687 [BatchNormalization] inputs: [686 -> (1, 24, 88, 168)[FLOAT]], [neck.dla_up.ida_2.node_1.conv.1.weight -> (24)[FLOAT]], [neck.dla_up.ida_2.node_1.conv.1.bias -> (24)[FLOAT]], [neck.dla_up.ida_2.node_1.conv.1.running_mean -> (24)[FLOAT]], [neck.dla_up.ida_2.node_1.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_687 for ONNX node: node_of_687
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 687 for ONNX tensor: 687
[11/24/2022-12:07:38] [V] [TRT] node_of_687 [BatchNormalization] outputs: [687 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_688 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 687
[11/24/2022-12:07:38] [V] [TRT] node_of_688 [Relu] inputs: [687 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_688 for ONNX node: node_of_688
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 688 for ONNX tensor: 688
[11/24/2022-12:07:38] [V] [TRT] node_of_688 [Relu] outputs: [688 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_689 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 672
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_689 [Conv] inputs: [672 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_2.proj_2.conv.0.weight -> (24, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_689 for ONNX node: node_of_689
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 689 for ONNX tensor: 689
[11/24/2022-12:07:38] [V] [TRT] node_of_689 [Conv] outputs: [689 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_690 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 689
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_690 [BatchNormalization] inputs: [689 -> (1, 24, 44, 84)[FLOAT]], [neck.dla_up.ida_2.proj_2.conv.1.weight -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_2.conv.1.bias -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_2.conv.1.running_mean -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_2.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_690 for ONNX node: node_of_690
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 690 for ONNX tensor: 690
[11/24/2022-12:07:38] [V] [TRT] node_of_690 [BatchNormalization] outputs: [690 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_691 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 690
[11/24/2022-12:07:38] [V] [TRT] node_of_691 [Relu] inputs: [690 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_691 for ONNX node: node_of_691
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 691 for ONNX tensor: 691
[11/24/2022-12:07:38] [V] [TRT] node_of_691 [Relu] outputs: [691 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_692 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 691
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.up_2.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_692 [ConvTranspose] inputs: [691 -> (1, 24, 44, 84)[FLOAT]], [neck.dla_up.ida_2.up_2.weight -> (24, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_692 for ONNX node: node_of_692
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 692 for ONNX tensor: 692
[11/24/2022-12:07:38] [V] [TRT] node_of_692 [ConvTranspose] outputs: [692 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_693 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 692
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 688
[11/24/2022-12:07:38] [V] [TRT] node_of_693 [Add] inputs: [692 -> (1, 24, 88, 168)[FLOAT]], [688 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_693 for ONNX node: node_of_693
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 693 for ONNX tensor: 693
[11/24/2022-12:07:38] [V] [TRT] node_of_693 [Add] outputs: [693 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_694 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 693
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_694 [Conv] inputs: [693 -> (1, 24, 88, 168)[FLOAT]], [neck.dla_up.ida_2.node_2.conv.0.weight -> (24, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_694 for ONNX node: node_of_694
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 694 for ONNX tensor: 694
[11/24/2022-12:07:38] [V] [TRT] node_of_694 [Conv] outputs: [694 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_695 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 694
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_695 [BatchNormalization] inputs: [694 -> (1, 24, 88, 168)[FLOAT]], [neck.dla_up.ida_2.node_2.conv.1.weight -> (24)[FLOAT]], [neck.dla_up.ida_2.node_2.conv.1.bias -> (24)[FLOAT]], [neck.dla_up.ida_2.node_2.conv.1.running_mean -> (24)[FLOAT]], [neck.dla_up.ida_2.node_2.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_695 for ONNX node: node_of_695
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 695 for ONNX tensor: 695
[11/24/2022-12:07:38] [V] [TRT] node_of_695 [BatchNormalization] outputs: [695 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_696 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 695
[11/24/2022-12:07:38] [V] [TRT] node_of_696 [Relu] inputs: [695 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_696 for ONNX node: node_of_696
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 696 for ONNX tensor: 696
[11/24/2022-12:07:38] [V] [TRT] node_of_696 [Relu] outputs: [696 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_697 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 680
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_3.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_697 [Conv] inputs: [680 -> (1, 32, 44, 84)[FLOAT]], [neck.dla_up.ida_2.proj_3.conv.0.weight -> (24, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_697 for ONNX node: node_of_697
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 697 for ONNX tensor: 697
[11/24/2022-12:07:38] [V] [TRT] node_of_697 [Conv] outputs: [697 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_698 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 697
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_3.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_3.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_3.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.proj_3.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_698 [BatchNormalization] inputs: [697 -> (1, 24, 44, 84)[FLOAT]], [neck.dla_up.ida_2.proj_3.conv.1.weight -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_3.conv.1.bias -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_3.conv.1.running_mean -> (24)[FLOAT]], [neck.dla_up.ida_2.proj_3.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_698 for ONNX node: node_of_698
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 698 for ONNX tensor: 698
[11/24/2022-12:07:38] [V] [TRT] node_of_698 [BatchNormalization] outputs: [698 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_699 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 698
[11/24/2022-12:07:38] [V] [TRT] node_of_699 [Relu] inputs: [698 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_699 for ONNX node: node_of_699
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 699 for ONNX tensor: 699
[11/24/2022-12:07:38] [V] [TRT] node_of_699 [Relu] outputs: [699 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_700 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 699
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.up_3.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_700 [ConvTranspose] inputs: [699 -> (1, 24, 44, 84)[FLOAT]], [neck.dla_up.ida_2.up_3.weight -> (24, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_700 for ONNX node: node_of_700
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 700 for ONNX tensor: 700
[11/24/2022-12:07:38] [V] [TRT] node_of_700 [ConvTranspose] outputs: [700 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_701 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 700
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 696
[11/24/2022-12:07:38] [V] [TRT] node_of_701 [Add] inputs: [700 -> (1, 24, 88, 168)[FLOAT]], [696 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_701 for ONNX node: node_of_701
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 701 for ONNX tensor: 701
[11/24/2022-12:07:38] [V] [TRT] node_of_701 [Add] outputs: [701 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_702 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 701
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_3.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_702 [Conv] inputs: [701 -> (1, 24, 88, 168)[FLOAT]], [neck.dla_up.ida_2.node_3.conv.0.weight -> (24, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_702 for ONNX node: node_of_702
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 702 for ONNX tensor: 702
[11/24/2022-12:07:38] [V] [TRT] node_of_702 [Conv] outputs: [702 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_703 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 702
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_3.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_3.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_3.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.dla_up.ida_2.node_3.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_703 [BatchNormalization] inputs: [702 -> (1, 24, 88, 168)[FLOAT]], [neck.dla_up.ida_2.node_3.conv.1.weight -> (24)[FLOAT]], [neck.dla_up.ida_2.node_3.conv.1.bias -> (24)[FLOAT]], [neck.dla_up.ida_2.node_3.conv.1.running_mean -> (24)[FLOAT]], [neck.dla_up.ida_2.node_3.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_703 for ONNX node: node_of_703
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 703 for ONNX tensor: 703
[11/24/2022-12:07:38] [V] [TRT] node_of_703 [BatchNormalization] outputs: [703 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_704 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 703
[11/24/2022-12:07:38] [V] [TRT] node_of_704 [Relu] inputs: [703 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_704 for ONNX node: node_of_704
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 704 for ONNX tensor: 704
[11/24/2022-12:07:38] [V] [TRT] node_of_704 [Relu] outputs: [704 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_705 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 680
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_705 [Conv] inputs: [680 -> (1, 32, 44, 84)[FLOAT]], [neck.ida_up.proj_1.conv.0.weight -> (24, 32, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 32, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_705 for ONNX node: node_of_705
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 44, 84)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 705 for ONNX tensor: 705
[11/24/2022-12:07:38] [V] [TRT] node_of_705 [Conv] outputs: [705 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_706 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 705
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_706 [BatchNormalization] inputs: [705 -> (1, 24, 44, 84)[FLOAT]], [neck.ida_up.proj_1.conv.1.weight -> (24)[FLOAT]], [neck.ida_up.proj_1.conv.1.bias -> (24)[FLOAT]], [neck.ida_up.proj_1.conv.1.running_mean -> (24)[FLOAT]], [neck.ida_up.proj_1.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_706 for ONNX node: node_of_706
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 706 for ONNX tensor: 706
[11/24/2022-12:07:38] [V] [TRT] node_of_706 [BatchNormalization] outputs: [706 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_707 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 706
[11/24/2022-12:07:38] [V] [TRT] node_of_707 [Relu] inputs: [706 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_707 for ONNX node: node_of_707
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 707 for ONNX tensor: 707
[11/24/2022-12:07:38] [V] [TRT] node_of_707 [Relu] outputs: [707 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_708 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 707
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.up_1.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_708 [ConvTranspose] inputs: [707 -> (1, 24, 44, 84)[FLOAT]], [neck.ida_up.up_1.weight -> (24, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_708 for ONNX node: node_of_708
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 708 for ONNX tensor: 708
[11/24/2022-12:07:38] [V] [TRT] node_of_708 [ConvTranspose] outputs: [708 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_709 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 708
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 704
[11/24/2022-12:07:38] [V] [TRT] node_of_709 [Add] inputs: [708 -> (1, 24, 88, 168)[FLOAT]], [704 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_709 for ONNX node: node_of_709
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 709 for ONNX tensor: 709
[11/24/2022-12:07:38] [V] [TRT] node_of_709 [Add] outputs: [709 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_710 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 709
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_1.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_710 [Conv] inputs: [709 -> (1, 24, 88, 168)[FLOAT]], [neck.ida_up.node_1.conv.0.weight -> (24, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_710 for ONNX node: node_of_710
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 710 for ONNX tensor: 710
[11/24/2022-12:07:38] [V] [TRT] node_of_710 [Conv] outputs: [710 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_711 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 710
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_1.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_1.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_1.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_1.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_711 [BatchNormalization] inputs: [710 -> (1, 24, 88, 168)[FLOAT]], [neck.ida_up.node_1.conv.1.weight -> (24)[FLOAT]], [neck.ida_up.node_1.conv.1.bias -> (24)[FLOAT]], [neck.ida_up.node_1.conv.1.running_mean -> (24)[FLOAT]], [neck.ida_up.node_1.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_711 for ONNX node: node_of_711
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 711 for ONNX tensor: 711
[11/24/2022-12:07:38] [V] [TRT] node_of_711 [BatchNormalization] outputs: [711 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_712 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 711
[11/24/2022-12:07:38] [V] [TRT] node_of_712 [Relu] inputs: [711 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_712 for ONNX node: node_of_712
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 712 for ONNX tensor: 712
[11/24/2022-12:07:38] [V] [TRT] node_of_712 [Relu] outputs: [712 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_713 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 664
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_713 [Conv] inputs: [664 -> (1, 96, 22, 42)[FLOAT]], [neck.ida_up.proj_2.conv.0.weight -> (24, 96, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 96, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_713 for ONNX node: node_of_713
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 22, 42)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 713 for ONNX tensor: 713
[11/24/2022-12:07:38] [V] [TRT] node_of_713 [Conv] outputs: [713 -> (1, 24, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_714 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 713
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.proj_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_714 [BatchNormalization] inputs: [713 -> (1, 24, 22, 42)[FLOAT]], [neck.ida_up.proj_2.conv.1.weight -> (24)[FLOAT]], [neck.ida_up.proj_2.conv.1.bias -> (24)[FLOAT]], [neck.ida_up.proj_2.conv.1.running_mean -> (24)[FLOAT]], [neck.ida_up.proj_2.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_714 for ONNX node: node_of_714
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 714 for ONNX tensor: 714
[11/24/2022-12:07:38] [V] [TRT] node_of_714 [BatchNormalization] outputs: [714 -> (1, 24, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_715 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 714
[11/24/2022-12:07:38] [V] [TRT] node_of_715 [Relu] inputs: [714 -> (1, 24, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_715 for ONNX node: node_of_715
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 715 for ONNX tensor: 715
[11/24/2022-12:07:38] [V] [TRT] node_of_715 [Relu] outputs: [715 -> (1, 24, 22, 42)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_716 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 715
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.up_2.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_716 [ConvTranspose] inputs: [715 -> (1, 24, 22, 42)[FLOAT]], [neck.ida_up.up_2.0.weight -> (24, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_716 for ONNX node: node_of_716
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 716 for ONNX tensor: 716
[11/24/2022-12:07:38] [V] [TRT] node_of_716 [ConvTranspose] outputs: [716 -> (1, 24, 44, 84)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_717 [ConvTranspose]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 716
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.up_2.1.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_717 [ConvTranspose] inputs: [716 -> (1, 24, 44, 84)[FLOAT]], [neck.ida_up.up_2.1.weight -> (24, 1, 4, 4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Running deconvolution with: 
Padding mode: NOTSET
Pre-padding: (1, 1)
Post-padding: (1, 1)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_717 for ONNX node: node_of_717
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 717 for ONNX tensor: 717
[11/24/2022-12:07:38] [V] [TRT] node_of_717 [ConvTranspose] outputs: [717 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_718 [Add]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 717
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 712
[11/24/2022-12:07:38] [V] [TRT] node_of_718 [Add] inputs: [717 -> (1, 24, 88, 168)[FLOAT]], [712 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_718 for ONNX node: node_of_718
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 718 for ONNX tensor: 718
[11/24/2022-12:07:38] [V] [TRT] node_of_718 [Add] outputs: [718 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_719 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 718
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_2.conv.0.weight
[11/24/2022-12:07:38] [V] [TRT] node_of_719 [Conv] inputs: [718 -> (1, 24, 88, 168)[FLOAT]], [neck.ida_up.node_2.conv.0.weight -> (24, 24, 1, 1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_719 for ONNX node: node_of_719
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 719 for ONNX tensor: 719
[11/24/2022-12:07:38] [V] [TRT] node_of_719 [Conv] outputs: [719 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_720 [BatchNormalization]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 719
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_2.conv.1.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_2.conv.1.bias
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_2.conv.1.running_mean
[11/24/2022-12:07:38] [V] [TRT] Searching for input: neck.ida_up.node_2.conv.1.running_var
[11/24/2022-12:07:38] [V] [TRT] node_of_720 [BatchNormalization] inputs: [719 -> (1, 24, 88, 168)[FLOAT]], [neck.ida_up.node_2.conv.1.weight -> (24)[FLOAT]], [neck.ida_up.node_2.conv.1.bias -> (24)[FLOAT]], [neck.ida_up.node_2.conv.1.running_mean -> (24)[FLOAT]], [neck.ida_up.node_2.conv.1.running_var -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_720 for ONNX node: node_of_720
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 720 for ONNX tensor: 720
[11/24/2022-12:07:38] [V] [TRT] node_of_720 [BatchNormalization] outputs: [720 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_721 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 720
[11/24/2022-12:07:38] [V] [TRT] node_of_721 [Relu] inputs: [720 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_721 for ONNX node: node_of_721
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 721 for ONNX tensor: 721
[11/24/2022-12:07:38] [V] [TRT] node_of_721 [Relu] outputs: [721 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_722 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: wh.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: wh.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_722 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [wh.0.weight -> (64, 24, 3, 3)[FLOAT]], [wh.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_722 for ONNX node: node_of_722
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 722 for ONNX tensor: 722
[11/24/2022-12:07:38] [V] [TRT] node_of_722 [Conv] outputs: [722 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_723 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 722
[11/24/2022-12:07:38] [V] [TRT] node_of_723 [Relu] inputs: [722 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_723 for ONNX node: node_of_723
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 723 for ONNX tensor: 723
[11/24/2022-12:07:38] [V] [TRT] node_of_723 [Relu] outputs: [723 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_724 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 723
[11/24/2022-12:07:38] [V] [TRT] Searching for input: wh.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: wh.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_724 [Conv] inputs: [723 -> (1, 64, 88, 168)[FLOAT]], [wh.2.weight -> (2, 64, 1, 1)[FLOAT]], [wh.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_724 for ONNX node: node_of_724
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724
[11/24/2022-12:07:38] [V] [TRT] node_of_724 [Conv] outputs: [724 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_725 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_725 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [reg.0.weight -> (64, 24, 3, 3)[FLOAT]], [reg.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_725 for ONNX node: node_of_725
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 725 for ONNX tensor: 725
[11/24/2022-12:07:38] [V] [TRT] node_of_725 [Conv] outputs: [725 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_726 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 725
[11/24/2022-12:07:38] [V] [TRT] node_of_726 [Relu] inputs: [725 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_726 for ONNX node: node_of_726
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 726 for ONNX tensor: 726
[11/24/2022-12:07:38] [V] [TRT] node_of_726 [Relu] outputs: [726 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_727 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 726
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_727 [Conv] inputs: [726 -> (1, 64, 88, 168)[FLOAT]], [reg.2.weight -> (2, 64, 1, 1)[FLOAT]], [reg.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_727 for ONNX node: node_of_727
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 727 for ONNX tensor: 727
[11/24/2022-12:07:38] [V] [TRT] node_of_727 [Conv] outputs: [727 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_728 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_728 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [hm.0.weight -> (64, 24, 3, 3)[FLOAT]], [hm.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_728 for ONNX node: node_of_728
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 728 for ONNX tensor: 728
[11/24/2022-12:07:38] [V] [TRT] node_of_728 [Conv] outputs: [728 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_729 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 728
[11/24/2022-12:07:38] [V] [TRT] node_of_729 [Relu] inputs: [728 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_729 for ONNX node: node_of_729
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 729 for ONNX tensor: 729
[11/24/2022-12:07:38] [V] [TRT] node_of_729 [Relu] outputs: [729 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_730 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 729
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_730 [Conv] inputs: [729 -> (1, 64, 88, 168)[FLOAT]], [hm.2.weight -> (16, 64, 1, 1)[FLOAT]], [hm.2.bias -> (16)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_730 for ONNX node: node_of_730
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 16, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 730 for ONNX tensor: 730
[11/24/2022-12:07:38] [V] [TRT] node_of_730 [Conv] outputs: [730 -> (1, 16, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_731 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_trunc.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_trunc.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_731 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [hm_trunc.0.weight -> (64, 24, 3, 3)[FLOAT]], [hm_trunc.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_731 for ONNX node: node_of_731
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 731 for ONNX tensor: 731
[11/24/2022-12:07:38] [V] [TRT] node_of_731 [Conv] outputs: [731 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_732 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 731
[11/24/2022-12:07:38] [V] [TRT] node_of_732 [Relu] inputs: [731 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_732 for ONNX node: node_of_732
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 732 for ONNX tensor: 732
[11/24/2022-12:07:38] [V] [TRT] node_of_732 [Relu] outputs: [732 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_733 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 732
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_trunc.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_trunc.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_733 [Conv] inputs: [732 -> (1, 64, 88, 168)[FLOAT]], [hm_trunc.2.weight -> (2, 64, 1, 1)[FLOAT]], [hm_trunc.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_733 for ONNX node: node_of_733
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733
[11/24/2022-12:07:38] [V] [TRT] node_of_733 [Conv] outputs: [733 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_734 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg_stixel.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg_stixel.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_734 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [reg_stixel.0.weight -> (64, 24, 3, 3)[FLOAT]], [reg_stixel.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_734 for ONNX node: node_of_734
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 734 for ONNX tensor: 734
[11/24/2022-12:07:38] [V] [TRT] node_of_734 [Conv] outputs: [734 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_735 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 734
[11/24/2022-12:07:38] [V] [TRT] node_of_735 [Relu] inputs: [734 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_735 for ONNX node: node_of_735
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 735 for ONNX tensor: 735
[11/24/2022-12:07:38] [V] [TRT] node_of_735 [Relu] outputs: [735 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_736 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 735
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg_stixel.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: reg_stixel.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_736 [Conv] inputs: [735 -> (1, 64, 88, 168)[FLOAT]], [reg_stixel.2.weight -> (2, 64, 1, 1)[FLOAT]], [reg_stixel.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_736 for ONNX node: node_of_736
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 736 for ONNX tensor: 736
[11/24/2022-12:07:38] [V] [TRT] node_of_736 [Conv] outputs: [736 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_737 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_stixel.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_stixel.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_737 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [hm_stixel.0.weight -> (64, 24, 3, 3)[FLOAT]], [hm_stixel.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_737 for ONNX node: node_of_737
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 737 for ONNX tensor: 737
[11/24/2022-12:07:38] [V] [TRT] node_of_737 [Conv] outputs: [737 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_738 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 737
[11/24/2022-12:07:38] [V] [TRT] node_of_738 [Relu] inputs: [737 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_738 for ONNX node: node_of_738
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738
[11/24/2022-12:07:38] [V] [TRT] node_of_738 [Relu] outputs: [738 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_739 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 738
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_stixel.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_stixel.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_739 [Conv] inputs: [738 -> (1, 64, 88, 168)[FLOAT]], [hm_stixel.2.weight -> (1, 64, 1, 1)[FLOAT]], [hm_stixel.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_739 for ONNX node: node_of_739
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739
[11/24/2022-12:07:38] [V] [TRT] node_of_739 [Conv] outputs: [739 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_740 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: scene.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: scene.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_740 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [scene.0.weight -> (64, 24, 3, 3)[FLOAT]], [scene.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_740 for ONNX node: node_of_740
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 740 for ONNX tensor: 740
[11/24/2022-12:07:38] [V] [TRT] node_of_740 [Conv] outputs: [740 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_741 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 740
[11/24/2022-12:07:38] [V] [TRT] node_of_741 [Relu] inputs: [740 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_741 for ONNX node: node_of_741
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741
[11/24/2022-12:07:38] [V] [TRT] node_of_741 [Relu] outputs: [741 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_742 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 741
[11/24/2022-12:07:38] [V] [TRT] Searching for input: scene.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: scene.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_742 [Conv] inputs: [741 -> (1, 64, 88, 168)[FLOAT]], [scene.2.weight -> (2, 64, 1, 1)[FLOAT]], [scene.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_742 for ONNX node: node_of_742
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742
[11/24/2022-12:07:38] [V] [TRT] node_of_742 [Conv] outputs: [742 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_743 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: rot.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: rot.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_743 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [rot.0.weight -> (64, 24, 3, 3)[FLOAT]], [rot.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_743 for ONNX node: node_of_743
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743
[11/24/2022-12:07:38] [V] [TRT] node_of_743 [Conv] outputs: [743 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_744 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 743
[11/24/2022-12:07:38] [V] [TRT] node_of_744 [Relu] inputs: [743 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_744 for ONNX node: node_of_744
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744
[11/24/2022-12:07:38] [V] [TRT] node_of_744 [Relu] outputs: [744 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_745 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 744
[11/24/2022-12:07:38] [V] [TRT] Searching for input: rot.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: rot.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_745 [Conv] inputs: [744 -> (1, 64, 88, 168)[FLOAT]], [rot.2.weight -> (24, 64, 1, 1)[FLOAT]], [rot.2.bias -> (24)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_745 for ONNX node: node_of_745
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 745 for ONNX tensor: 745
[11/24/2022-12:07:38] [V] [TRT] node_of_745 [Conv] outputs: [745 -> (1, 24, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_746 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dim.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dim.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_746 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [dim.0.weight -> (64, 24, 3, 3)[FLOAT]], [dim.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_746 for ONNX node: node_of_746
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 746 for ONNX tensor: 746
[11/24/2022-12:07:38] [V] [TRT] node_of_746 [Conv] outputs: [746 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_747 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 746
[11/24/2022-12:07:38] [V] [TRT] node_of_747 [Relu] inputs: [746 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_747 for ONNX node: node_of_747
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 747 for ONNX tensor: 747
[11/24/2022-12:07:38] [V] [TRT] node_of_747 [Relu] outputs: [747 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_748 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 747
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dim.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dim.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_748 [Conv] inputs: [747 -> (1, 64, 88, 168)[FLOAT]], [dim.2.weight -> (3, 64, 1, 1)[FLOAT]], [dim.2.bias -> (3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_748 for ONNX node: node_of_748
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 3, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 748 for ONNX tensor: 748
[11/24/2022-12:07:38] [V] [TRT] node_of_748 [Conv] outputs: [748 -> (1, 3, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_749 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep_uncertainty.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep_uncertainty.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_749 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [dep_uncertainty.0.weight -> (64, 24, 3, 3)[FLOAT]], [dep_uncertainty.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_749 for ONNX node: node_of_749
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 749 for ONNX tensor: 749
[11/24/2022-12:07:38] [V] [TRT] node_of_749 [Conv] outputs: [749 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_750 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 749
[11/24/2022-12:07:38] [V] [TRT] node_of_750 [Relu] inputs: [749 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_750 for ONNX node: node_of_750
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 750 for ONNX tensor: 750
[11/24/2022-12:07:38] [V] [TRT] node_of_750 [Relu] outputs: [750 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_751 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 750
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep_uncertainty.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep_uncertainty.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_751 [Conv] inputs: [750 -> (1, 64, 88, 168)[FLOAT]], [dep_uncertainty.2.weight -> (1, 64, 1, 1)[FLOAT]], [dep_uncertainty.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_751 for ONNX node: node_of_751
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 751 for ONNX tensor: 751
[11/24/2022-12:07:38] [V] [TRT] node_of_751 [Conv] outputs: [751 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_752 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: amodel_offset.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: amodel_offset.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_752 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [amodel_offset.0.weight -> (64, 24, 3, 3)[FLOAT]], [amodel_offset.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_752 for ONNX node: node_of_752
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 752 for ONNX tensor: 752
[11/24/2022-12:07:38] [V] [TRT] node_of_752 [Conv] outputs: [752 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_753 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 752
[11/24/2022-12:07:38] [V] [TRT] node_of_753 [Relu] inputs: [752 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_753 for ONNX node: node_of_753
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 753 for ONNX tensor: 753
[11/24/2022-12:07:38] [V] [TRT] node_of_753 [Relu] outputs: [753 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_754 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 753
[11/24/2022-12:07:38] [V] [TRT] Searching for input: amodel_offset.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: amodel_offset.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_754 [Conv] inputs: [753 -> (1, 64, 88, 168)[FLOAT]], [amodel_offset.2.weight -> (2, 64, 1, 1)[FLOAT]], [amodel_offset.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_754 for ONNX node: node_of_754
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 754 for ONNX tensor: 754
[11/24/2022-12:07:38] [V] [TRT] node_of_754 [Conv] outputs: [754 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_755 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: latd.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: latd.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_755 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [latd.0.weight -> (64, 24, 3, 3)[FLOAT]], [latd.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_755 for ONNX node: node_of_755
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 755 for ONNX tensor: 755
[11/24/2022-12:07:38] [V] [TRT] node_of_755 [Conv] outputs: [755 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_756 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 755
[11/24/2022-12:07:38] [V] [TRT] node_of_756 [Relu] inputs: [755 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_756 for ONNX node: node_of_756
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 756 for ONNX tensor: 756
[11/24/2022-12:07:38] [V] [TRT] node_of_756 [Relu] outputs: [756 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_757 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 756
[11/24/2022-12:07:38] [V] [TRT] Searching for input: latd.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: latd.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_757 [Conv] inputs: [756 -> (1, 64, 88, 168)[FLOAT]], [latd.2.weight -> (1, 64, 1, 1)[FLOAT]], [latd.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_757 for ONNX node: node_of_757
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 757 for ONNX tensor: 757
[11/24/2022-12:07:38] [V] [TRT] node_of_757 [Conv] outputs: [757 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_758 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_758 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [dep.0.weight -> (64, 24, 3, 3)[FLOAT]], [dep.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_758 for ONNX node: node_of_758
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 758 for ONNX tensor: 758
[11/24/2022-12:07:38] [V] [TRT] node_of_758 [Conv] outputs: [758 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_759 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 758
[11/24/2022-12:07:38] [V] [TRT] node_of_759 [Relu] inputs: [758 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_759 for ONNX node: node_of_759
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 759 for ONNX tensor: 759
[11/24/2022-12:07:38] [V] [TRT] node_of_759 [Relu] outputs: [759 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_760 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 759
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: dep.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_760 [Conv] inputs: [759 -> (1, 64, 88, 168)[FLOAT]], [dep.2.weight -> (1, 64, 1, 1)[FLOAT]], [dep.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_760 for ONNX node: node_of_760
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760
[11/24/2022-12:07:38] [V] [TRT] node_of_760 [Conv] outputs: [760 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_761 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcp_offset.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcp_offset.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_761 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [gcp_offset.0.weight -> (64, 24, 3, 3)[FLOAT]], [gcp_offset.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_761 for ONNX node: node_of_761
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 761 for ONNX tensor: 761
[11/24/2022-12:07:38] [V] [TRT] node_of_761 [Conv] outputs: [761 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_762 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 761
[11/24/2022-12:07:38] [V] [TRT] node_of_762 [Relu] inputs: [761 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_762 for ONNX node: node_of_762
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762
[11/24/2022-12:07:38] [V] [TRT] node_of_762 [Relu] outputs: [762 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_763 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 762
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcp_offset.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcp_offset.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_763 [Conv] inputs: [762 -> (1, 64, 88, 168)[FLOAT]], [gcp_offset.2.weight -> (2, 64, 1, 1)[FLOAT]], [gcp_offset.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_763 for ONNX node: node_of_763
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763
[11/24/2022-12:07:38] [V] [TRT] node_of_763 [Conv] outputs: [763 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_764 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_764 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [gcps.0.weight -> (64, 24, 3, 3)[FLOAT]], [gcps.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_764 for ONNX node: node_of_764
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764
[11/24/2022-12:07:38] [V] [TRT] node_of_764 [Conv] outputs: [764 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_765 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 764
[11/24/2022-12:07:38] [V] [TRT] node_of_765 [Relu] inputs: [764 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_765 for ONNX node: node_of_765
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 765 for ONNX tensor: 765
[11/24/2022-12:07:38] [V] [TRT] node_of_765 [Relu] outputs: [765 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_766 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 765
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_766 [Conv] inputs: [765 -> (1, 64, 88, 168)[FLOAT]], [gcps.2.weight -> (8, 64, 1, 1)[FLOAT]], [gcps.2.bias -> (8)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_766 for ONNX node: node_of_766
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 8
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 8, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766
[11/24/2022-12:07:38] [V] [TRT] node_of_766 [Conv] outputs: [766 -> (1, 8, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_767 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps_loff.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps_loff.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_767 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [gcps_loff.0.weight -> (64, 24, 3, 3)[FLOAT]], [gcps_loff.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_767 for ONNX node: node_of_767
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 767 for ONNX tensor: 767
[11/24/2022-12:07:38] [V] [TRT] node_of_767 [Conv] outputs: [767 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_768 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 767
[11/24/2022-12:07:38] [V] [TRT] node_of_768 [Relu] inputs: [767 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_768 for ONNX node: node_of_768
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 768 for ONNX tensor: 768
[11/24/2022-12:07:38] [V] [TRT] node_of_768 [Relu] outputs: [768 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_769 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 768
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps_loff.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: gcps_loff.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_769 [Conv] inputs: [768 -> (1, 64, 88, 168)[FLOAT]], [gcps_loff.2.weight -> (2, 64, 1, 1)[FLOAT]], [gcps_loff.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_769 for ONNX node: node_of_769
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769
[11/24/2022-12:07:38] [V] [TRT] node_of_769 [Conv] outputs: [769 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_770 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_gcp.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_gcp.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_770 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [hm_gcp.0.weight -> (64, 24, 3, 3)[FLOAT]], [hm_gcp.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_770 for ONNX node: node_of_770
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770
[11/24/2022-12:07:38] [V] [TRT] node_of_770 [Conv] outputs: [770 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_771 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 770
[11/24/2022-12:07:38] [V] [TRT] node_of_771 [Relu] inputs: [770 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_771 for ONNX node: node_of_771
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771
[11/24/2022-12:07:38] [V] [TRT] node_of_771 [Relu] outputs: [771 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_772 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 771
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_gcp.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: hm_gcp.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_772 [Conv] inputs: [771 -> (1, 64, 88, 168)[FLOAT]], [hm_gcp.2.weight -> (4, 64, 1, 1)[FLOAT]], [hm_gcp.2.bias -> (4)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_772 for ONNX node: node_of_772
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 4, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 772 for ONNX tensor: 772
[11/24/2022-12:07:38] [V] [TRT] node_of_772 [Conv] outputs: [772 -> (1, 4, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_773 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_pm.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_pm.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_773 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_pm.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_pm.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_773 for ONNX node: node_of_773
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773
[11/24/2022-12:07:38] [V] [TRT] node_of_773 [Conv] outputs: [773 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_774 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 773
[11/24/2022-12:07:38] [V] [TRT] node_of_774 [Relu] inputs: [773 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_774 for ONNX node: node_of_774
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 774 for ONNX tensor: 774
[11/24/2022-12:07:38] [V] [TRT] node_of_774 [Relu] outputs: [774 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_775 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 774
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_pm.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_pm.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_775 [Conv] inputs: [774 -> (1, 64, 88, 168)[FLOAT]], [lane_pm.2.weight -> (3, 64, 1, 1)[FLOAT]], [lane_pm.2.bias -> (3)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_775 for ONNX node: node_of_775
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 3, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 775 for ONNX tensor: 775
[11/24/2022-12:07:38] [V] [TRT] node_of_775 [Conv] outputs: [775 -> (1, 3, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_776 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_off.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_off.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_776 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_off.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_off.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_776 for ONNX node: node_of_776
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 776 for ONNX tensor: 776
[11/24/2022-12:07:38] [V] [TRT] node_of_776 [Conv] outputs: [776 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_777 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 776
[11/24/2022-12:07:38] [V] [TRT] node_of_777 [Relu] inputs: [776 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_777 for ONNX node: node_of_777
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 777 for ONNX tensor: 777
[11/24/2022-12:07:38] [V] [TRT] node_of_777 [Relu] outputs: [777 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_778 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 777
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_off.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_off.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_778 [Conv] inputs: [777 -> (1, 64, 88, 168)[FLOAT]], [lane_off.2.weight -> (2, 64, 1, 1)[FLOAT]], [lane_off.2.bias -> (2)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_778 for ONNX node: node_of_778
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 2, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 778 for ONNX tensor: 778
[11/24/2022-12:07:38] [V] [TRT] node_of_778 [Conv] outputs: [778 -> (1, 2, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_779 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_h.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_h.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_779 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_h.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_h.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_779 for ONNX node: node_of_779
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 779 for ONNX tensor: 779
[11/24/2022-12:07:38] [V] [TRT] node_of_779 [Conv] outputs: [779 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_780 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 779
[11/24/2022-12:07:38] [V] [TRT] node_of_780 [Relu] inputs: [779 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_780 for ONNX node: node_of_780
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 780 for ONNX tensor: 780
[11/24/2022-12:07:38] [V] [TRT] node_of_780 [Relu] outputs: [780 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_781 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 780
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_h.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_h.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_781 [Conv] inputs: [780 -> (1, 64, 88, 168)[FLOAT]], [lane_h.2.weight -> (1, 64, 1, 1)[FLOAT]], [lane_h.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_781 for ONNX node: node_of_781
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 781 for ONNX tensor: 781
[11/24/2022-12:07:38] [V] [TRT] node_of_781 [Conv] outputs: [781 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_782 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_auxi_im.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_auxi_im.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_782 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_auxi_im.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_auxi_im.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_782 for ONNX node: node_of_782
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 782 for ONNX tensor: 782
[11/24/2022-12:07:38] [V] [TRT] node_of_782 [Conv] outputs: [782 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_783 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 782
[11/24/2022-12:07:38] [V] [TRT] node_of_783 [Relu] inputs: [782 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_783 for ONNX node: node_of_783
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 783 for ONNX tensor: 783
[11/24/2022-12:07:38] [V] [TRT] node_of_783 [Relu] outputs: [783 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_784 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 783
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_auxi_im.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_auxi_im.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_784 [Conv] inputs: [783 -> (1, 64, 88, 168)[FLOAT]], [lane_auxi_im.2.weight -> (1, 64, 1, 1)[FLOAT]], [lane_auxi_im.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_784 for ONNX node: node_of_784
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 784 for ONNX tensor: 784
[11/24/2022-12:07:38] [V] [TRT] node_of_784 [Conv] outputs: [784 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_785 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_im.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_im.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_785 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_im.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_im.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_785 for ONNX node: node_of_785
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 785 for ONNX tensor: 785
[11/24/2022-12:07:38] [V] [TRT] node_of_785 [Conv] outputs: [785 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_786 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 785
[11/24/2022-12:07:38] [V] [TRT] node_of_786 [Relu] inputs: [785 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_786 for ONNX node: node_of_786
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786
[11/24/2022-12:07:38] [V] [TRT] node_of_786 [Relu] outputs: [786 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_787 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 786
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_im.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_im.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_787 [Conv] inputs: [786 -> (1, 64, 88, 168)[FLOAT]], [lane_im.2.weight -> (1, 64, 1, 1)[FLOAT]], [lane_im.2.bias -> (1)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_787 for ONNX node: node_of_787
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 1, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 787 for ONNX tensor: 787
[11/24/2022-12:07:38] [V] [TRT] node_of_787 [Conv] outputs: [787 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_788 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_category.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_category.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_788 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_category.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_category.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_788 for ONNX node: node_of_788
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 788 for ONNX tensor: 788
[11/24/2022-12:07:38] [V] [TRT] node_of_788 [Conv] outputs: [788 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_789 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 788
[11/24/2022-12:07:38] [V] [TRT] node_of_789 [Relu] inputs: [788 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_789 for ONNX node: node_of_789
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 789 for ONNX tensor: 789
[11/24/2022-12:07:38] [V] [TRT] node_of_789 [Relu] outputs: [789 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_790 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 789
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_category.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_category.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_790 [Conv] inputs: [789 -> (1, 64, 88, 168)[FLOAT]], [lane_category.2.weight -> (7, 64, 1, 1)[FLOAT]], [lane_category.2.bias -> (7)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_790 for ONNX node: node_of_790
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 7
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 7, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 790 for ONNX tensor: 790
[11/24/2022-12:07:38] [V] [TRT] node_of_790 [Conv] outputs: [790 -> (1, 7, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_791 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 721
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_color.0.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_color.0.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_791 [Conv] inputs: [721 -> (1, 24, 88, 168)[FLOAT]], [lane_color.0.weight -> (64, 24, 3, 3)[FLOAT]], [lane_color.0.bias -> (64)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 24, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_791 for ONNX node: node_of_791
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 791 for ONNX tensor: 791
[11/24/2022-12:07:38] [V] [TRT] node_of_791 [Conv] outputs: [791 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_792 [Relu]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 791
[11/24/2022-12:07:38] [V] [TRT] node_of_792 [Relu] inputs: [791 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_792 for ONNX node: node_of_792
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 792 for ONNX tensor: 792
[11/24/2022-12:07:38] [V] [TRT] node_of_792 [Relu] outputs: [792 -> (1, 64, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_793 [Conv]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 792
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_color.2.weight
[11/24/2022-12:07:38] [V] [TRT] Searching for input: lane_color.2.bias
[11/24/2022-12:07:38] [V] [TRT] node_of_793 [Conv] inputs: [792 -> (1, 64, 88, 168)[FLOAT]], [lane_color.2.weight -> (5, 64, 1, 1)[FLOAT]], [lane_color.2.bias -> (5)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Convolution input dimensions: (1, 64, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_793 for ONNX node: node_of_793
[11/24/2022-12:07:38] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 5
[11/24/2022-12:07:38] [V] [TRT] Convolution output dimensions: (1, 5, 88, 168)
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 793 for ONNX tensor: 793
[11/24/2022-12:07:38] [V] [TRT] node_of_793 [Conv] outputs: [793 -> (1, 5, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_794 [MaxPool]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 730
[11/24/2022-12:07:38] [V] [TRT] node_of_794 [MaxPool] inputs: [730 -> (1, 16, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_794 for ONNX node: node_of_794
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 794 for ONNX tensor: 794
[11/24/2022-12:07:38] [V] [TRT] node_of_794 [MaxPool] outputs: [794 -> (1, 16, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_795 [MaxPool]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 787
[11/24/2022-12:07:38] [V] [TRT] node_of_795 [MaxPool] inputs: [787 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_795 for ONNX node: node_of_795
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795
[11/24/2022-12:07:38] [V] [TRT] node_of_795 [MaxPool] outputs: [795 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_head_2d [Concat]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 724
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 727
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 730
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 733
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 736
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 739
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 742
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 794
[11/24/2022-12:07:38] [V] [TRT] node_of_head_2d [Concat] inputs: [724 -> (1, 2, 88, 168)[FLOAT]], [727 -> (1, 2, 88, 168)[FLOAT]], [730 -> (1, 16, 88, 168)[FLOAT]], [733 -> (1, 2, 88, 168)[FLOAT]], [736 -> (1, 2, 88, 168)[FLOAT]], [739 -> (1, 1, 88, 168)[FLOAT]], [742 -> (1, 2, 88, 168)[FLOAT]], [794 -> (1, 16, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_head_2d for ONNX node: node_of_head_2d
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: head_2d_200 for ONNX tensor: head_2d
[11/24/2022-12:07:38] [V] [TRT] node_of_head_2d [Concat] outputs: [head_2d -> (1, 43, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_head_3d [Concat]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 745
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 748
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 751
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 754
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 757
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 760
[11/24/2022-12:07:38] [V] [TRT] node_of_head_3d [Concat] inputs: [745 -> (1, 24, 88, 168)[FLOAT]], [748 -> (1, 3, 88, 168)[FLOAT]], [751 -> (1, 1, 88, 168)[FLOAT]], [754 -> (1, 2, 88, 168)[FLOAT]], [757 -> (1, 1, 88, 168)[FLOAT]], [760 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_head_3d for ONNX node: node_of_head_3d
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: head_3d_201 for ONNX tensor: head_3d
[11/24/2022-12:07:38] [V] [TRT] node_of_head_3d [Concat] outputs: [head_3d -> (1, 32, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_head_gcp [Concat]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 763
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 766
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 769
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 772
[11/24/2022-12:07:38] [V] [TRT] node_of_head_gcp [Concat] inputs: [763 -> (1, 2, 88, 168)[FLOAT]], [766 -> (1, 8, 88, 168)[FLOAT]], [769 -> (1, 2, 88, 168)[FLOAT]], [772 -> (1, 4, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_head_gcp for ONNX node: node_of_head_gcp
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: head_gcp_202 for ONNX tensor: head_gcp
[11/24/2022-12:07:38] [V] [TRT] node_of_head_gcp [Concat] outputs: [head_gcp -> (1, 16, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Parsing node: node_of_head_lane [Concat]
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 775
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 778
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 781
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 784
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 787
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 790
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 793
[11/24/2022-12:07:38] [V] [TRT] Searching for input: 795
[11/24/2022-12:07:38] [V] [TRT] node_of_head_lane [Concat] inputs: [775 -> (1, 3, 88, 168)[FLOAT]], [778 -> (1, 2, 88, 168)[FLOAT]], [781 -> (1, 1, 88, 168)[FLOAT]], [784 -> (1, 1, 88, 168)[FLOAT]], [787 -> (1, 1, 88, 168)[FLOAT]], [790 -> (1, 7, 88, 168)[FLOAT]], [793 -> (1, 5, 88, 168)[FLOAT]], [795 -> (1, 1, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Registering layer: node_of_head_lane for ONNX node: node_of_head_lane
[11/24/2022-12:07:38] [V] [TRT] Registering tensor: head_lane_203 for ONNX tensor: head_lane
[11/24/2022-12:07:38] [V] [TRT] node_of_head_lane [Concat] outputs: [head_lane -> (1, 21, 88, 168)[FLOAT]], 
[11/24/2022-12:07:38] [V] [TRT] Marking head_2d_200 as output: head_2d
[11/24/2022-12:07:38] [V] [TRT] Marking head_3d_201 as output: head_3d
[11/24/2022-12:07:38] [V] [TRT] Marking head_gcp_202 as output: head_gcp
[11/24/2022-12:07:38] [V] [TRT] Marking head_lane_203 as output: head_lane
[11/24/2022-12:07:38] [I] Finish parsing network model
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for (Unnamed Layer* 0) [Constant]_output to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 509 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for i to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 510 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 511 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 512 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 513 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 514 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 515 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 516 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 517 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 518 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 519 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 520 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 521 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 522 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 523 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 524 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 525 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 526 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 527 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 528 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 529 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 530 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 531 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 532 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 533 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 534 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 535 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 536 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 537 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 538 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 539 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 540 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 541 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 542 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 543 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 544 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 545 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 546 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 547 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 548 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 549 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 550 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 551 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 552 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 553 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 554 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 555 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 556 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 557 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 558 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 559 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 560 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 561 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 562 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 563 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 564 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 565 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 566 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 567 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 568 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 569 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 570 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 571 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 572 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 573 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 574 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 575 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 576 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 577 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 578 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 579 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 580 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 581 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 582 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 583 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 584 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 585 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 586 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 587 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 588 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 589 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 590 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 591 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 592 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 593 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 594 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 595 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 596 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 597 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 598 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 599 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 600 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 601 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 602 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 603 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 604 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 605 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 606 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 607 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 608 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 609 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 610 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 611 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 612 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 613 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 614 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 615 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 616 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 617 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 618 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 619 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 620 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 621 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 622 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 623 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 624 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 625 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 626 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 627 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 628 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 629 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 630 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 631 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 632 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 633 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 634 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 635 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 636 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 637 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 638 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 639 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 640 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 641 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 642 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 643 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 644 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 645 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 646 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 647 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 648 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 649 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 650 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 651 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 652 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 653 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 654 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 655 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 656 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 657 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 658 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 659 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 660 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 661 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 662 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 663 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 664 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 665 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 666 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 667 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 668 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 669 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 670 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 671 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 672 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 673 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 674 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 675 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 676 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 677 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 678 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 679 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 680 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 681 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 682 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 683 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 684 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 685 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 686 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 687 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 688 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 689 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 690 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 691 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 692 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 693 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 694 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 695 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 696 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 697 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 698 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 699 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 700 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 701 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 702 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 703 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 704 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 705 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 706 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 707 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 708 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 709 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 710 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 711 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 712 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 713 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 714 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 715 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 716 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 717 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 718 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 719 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 720 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 721 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 722 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 723 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 724 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 725 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 726 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 727 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 728 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 729 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 730 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 731 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 732 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 733 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 734 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 735 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 736 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 737 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 738 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 739 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 740 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 741 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 742 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 743 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 744 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 745 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 746 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 747 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 748 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 749 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 750 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 751 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 752 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 753 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 754 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 755 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 756 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 757 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 758 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 759 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 760 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 761 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 762 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 763 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 764 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 765 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 766 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 767 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 768 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 769 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 770 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 771 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 772 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 773 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 774 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 775 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 776 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 777 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 778 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 779 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 780 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 781 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 782 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 783 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 784 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 785 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 786 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 787 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 788 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 789 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 790 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 791 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 792 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 793 to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 794 to [-2,2]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for 795 to [-2,2]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for head_2d to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for head_3d to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for head_gcp to [-4,4]
[11/24/2022-12:07:38] [V] [TRT] Setting dynamic range for head_lane to [-4,4]
[11/24/2022-12:07:38] [W] [TRT] Calibrator is not being used. Users must provide dynamic range for all tensors that are not Int32 or Bool.
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.015748,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.015748,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] User overriding scale with scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:38] [V] [TRT] Configuring builder for Int8 Mode completed in 0.00327621 seconds.
[11/24/2022-12:07:38] [V] [TRT] Applying generic optimizations to the graph for inference.
[11/24/2022-12:07:38] [V] [TRT] Original: 292 layers
[11/24/2022-12:07:38] [V] [TRT] After dead-layer removal: 292 layers
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_511 with node_of_512
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_514 with node_of_515
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_517 with node_of_518
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_519 with node_of_520
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_522 with node_of_523
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_525 with node_of_526
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_527 with node_of_528
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_530 with node_of_531
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_533 with node_of_534
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_536 with node_of_537
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_539 with node_of_540
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_542 with node_of_543
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_544 with node_of_545
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_547 with node_of_548
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_550 with node_of_551
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_553 with node_of_554
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_556 with node_of_557
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_559 with node_of_560
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_562 with node_of_563
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_565 with node_of_566
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_568 with node_of_569
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_570 with node_of_571
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_573 with node_of_574
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_576 with node_of_577
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_579 with node_of_580
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_582 with node_of_583
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_585 with node_of_586
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_588 with node_of_589
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_591 with node_of_592
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_594 with node_of_595
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_597 with node_of_598
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_600 with node_of_601
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_603 with node_of_604
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_605 with node_of_606
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_608 with node_of_609
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_611 with node_of_612
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_614 with node_of_615
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_617 with node_of_618
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_620 with node_of_621
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_623 with node_of_624
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_626 with node_of_627
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_629 with node_of_630
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_631 with node_of_632
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_634 with node_of_635
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_637 with node_of_638
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_640 with node_of_641
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_643 with node_of_644
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_646 with node_of_647
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_649 with node_of_650
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_652 with node_of_653
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_655 with node_of_656
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_657 with node_of_658
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_662 with node_of_663
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_665 with node_of_666
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_670 with node_of_671
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_673 with node_of_674
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_678 with node_of_679
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_681 with node_of_682
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_686 with node_of_687
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_689 with node_of_690
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_694 with node_of_695
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_697 with node_of_698
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_702 with node_of_703
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_705 with node_of_706
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_710 with node_of_711
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_713 with node_of_714
[11/24/2022-12:07:38] [V] [TRT] Running: ConvScaleFusion
[11/24/2022-12:07:38] [V] [TRT] ConvScaleFusion: Fusing node_of_719 with node_of_720
[11/24/2022-12:07:38] [V] [TRT] After Myelin optimization: 225 layers
[11/24/2022-12:07:38] [V] [TRT] Applying ScaleNodes fusions.
[11/24/2022-12:07:38] [V] [TRT] After scale fusion: 225 layers
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_533 + node_of_534 with node_of_535
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_550 + node_of_551 with node_of_552
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_559 + node_of_560 with node_of_561
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_576 + node_of_577 with node_of_578
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_585 + node_of_586 with node_of_587
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_594 + node_of_595 with node_of_596
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_611 + node_of_612 with node_of_613
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_620 + node_of_621 with node_of_622
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_637 + node_of_638 with node_of_639
[11/24/2022-12:07:38] [V] [TRT] Running: ConvEltwiseSumFusion
[11/24/2022-12:07:38] [V] [TRT] ConvEltwiseSumFusion: Fusing node_of_646 + node_of_647 with node_of_648
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_657 + node_of_658 with node_of_659
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_662 + node_of_663 with node_of_664
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_665 + node_of_666 with node_of_667
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_670 + node_of_671 with node_of_672
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_673 + node_of_674 with node_of_675
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_678 + node_of_679 with node_of_680
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_681 + node_of_682 with node_of_683
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_686 + node_of_687 with node_of_688
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_689 + node_of_690 with node_of_691
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_694 + node_of_695 with node_of_696
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_697 + node_of_698 with node_of_699
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_702 + node_of_703 with node_of_704
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_705 + node_of_706 with node_of_707
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_710 + node_of_711 with node_of_712
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_713 + node_of_714 with node_of_715
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_719 + node_of_720 with node_of_721
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_722 with node_of_723
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_725 with node_of_726
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_728 with node_of_729
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_731 with node_of_732
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_734 with node_of_735
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_737 with node_of_738
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_740 with node_of_741
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_743 with node_of_744
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_746 with node_of_747
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_749 with node_of_750
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_752 with node_of_753
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_755 with node_of_756
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_758 with node_of_759
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_761 with node_of_762
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_764 with node_of_765
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_767 with node_of_768
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_770 with node_of_771
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_773 with node_of_774
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_776 with node_of_777
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_779 with node_of_780
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_782 with node_of_783
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_785 with node_of_786
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_788 with node_of_789
[11/24/2022-12:07:38] [V] [TRT] Running: ConvReluFusion
[11/24/2022-12:07:38] [V] [TRT] ConvReluFusion: Fusing node_of_791 with node_of_792
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_513 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_516 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_521 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_524 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_529 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_532 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_538 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_541 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_546 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_549 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_555 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_558 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_564 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_567 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_572 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_575 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_581 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_584 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_590 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_593 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_599 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_602 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_607 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_610 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_616 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_619 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_625 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_628 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_633 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_636 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_642 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_645 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_651 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ActivationToPointwiseConversion
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_654 from ACTIVATION to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_511 + node_of_512 with PWN(node_of_513)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_514 + node_of_515 with PWN(node_of_516)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_519 + node_of_520 with PWN(node_of_521)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_522 + node_of_523 with PWN(node_of_524)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_527 + node_of_528 with PWN(node_of_529)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_530 + node_of_531 with PWN(node_of_532)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_536 + node_of_537 with PWN(node_of_538)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_539 + node_of_540 with PWN(node_of_541)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_544 + node_of_545 with PWN(node_of_546)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_547 + node_of_548 with PWN(node_of_549)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_553 + node_of_554 with PWN(node_of_555)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_556 + node_of_557 with PWN(node_of_558)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_562 + node_of_563 with PWN(node_of_564)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_565 + node_of_566 with PWN(node_of_567)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_570 + node_of_571 with PWN(node_of_572)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_573 + node_of_574 with PWN(node_of_575)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_579 + node_of_580 with PWN(node_of_581)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_582 + node_of_583 with PWN(node_of_584)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_588 + node_of_589 with PWN(node_of_590)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_591 + node_of_592 with PWN(node_of_593)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_597 + node_of_598 with PWN(node_of_599)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_600 + node_of_601 with PWN(node_of_602)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_605 + node_of_606 with PWN(node_of_607)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_608 + node_of_609 with PWN(node_of_610)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_614 + node_of_615 with PWN(node_of_616)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_617 + node_of_618 with PWN(node_of_619)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_623 + node_of_624 with PWN(node_of_625)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_626 + node_of_627 with PWN(node_of_628)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_631 + node_of_632 with PWN(node_of_633)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_634 + node_of_635 with PWN(node_of_636)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_640 + node_of_641 with PWN(node_of_642)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_643 + node_of_644 with PWN(node_of_645)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_649 + node_of_650 with PWN(node_of_651)
[11/24/2022-12:07:39] [V] [TRT] Running: ConvPointWiseClipFusion
[11/24/2022-12:07:39] [V] [TRT] ConvPointWiseClipFusion: Fusing node_of_652 + node_of_653 with PWN(node_of_654)
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_661 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_669 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_677 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_685 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_693 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_701 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_709 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] Running: EltwiseAddToPwn
[11/24/2022-12:07:39] [V] [TRT] Swap the layer type of node_of_718 from ELEMENTWISE to POINTWISE
[11/24/2022-12:07:39] [V] [TRT] After vertical fusions: 141 layers
[11/24/2022-12:07:39] [V] [TRT] After dupe layer removal: 141 layers
[11/24/2022-12:07:39] [V] [TRT] After final dead-layer removal: 141 layers
[11/24/2022-12:07:39] [V] [TRT] Merging layers: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744
[11/24/2022-12:07:39] [V] [TRT] Merging layers: node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768
[11/24/2022-12:07:39] [V] [TRT] Merging layers: node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792
[11/24/2022-12:07:39] [V] [TRT] After tensor merging: 120 layers
[11/24/2022-12:07:39] [V] [TRT] After slice removal: 120 layers
[11/24/2022-12:07:39] [V] [TRT] Eliminating concatenation node_of_head_lane
[11/24/2022-12:07:39] [V] [TRT] Retargeting 775 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 775 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 778 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 778 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 781 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 781 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 784 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 784 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Generating copy for 787 to head_lane because concat input is consumed by producer of another input.
[11/24/2022-12:07:39] [V] [TRT] Assigning 787 copy scale and zero-point 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Overriding 787 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 790 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 790 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 793 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 793 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 795 to head_lane
[11/24/2022-12:07:39] [V] [TRT] Overriding 795 scale and zero-point Quantization(scale: {0.015748,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_lane scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Eliminating concatenation node_of_head_gcp
[11/24/2022-12:07:39] [V] [TRT] Retargeting 763 to head_gcp
[11/24/2022-12:07:39] [V] [TRT] Overriding 763 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_gcp scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 766 to head_gcp
[11/24/2022-12:07:39] [V] [TRT] Overriding 766 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_gcp scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 769 to head_gcp
[11/24/2022-12:07:39] [V] [TRT] Overriding 769 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_gcp scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 772 to head_gcp
[11/24/2022-12:07:39] [V] [TRT] Overriding 772 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_gcp scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Eliminating concatenation node_of_head_3d
[11/24/2022-12:07:39] [V] [TRT] Retargeting 745 to head_3d
[11/24/2022-12:07:39] [V] [TRT] Overriding 745 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_3d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 748 to head_3d
[11/24/2022-12:07:39] [V] [TRT] Overriding 748 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_3d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 751 to head_3d
[11/24/2022-12:07:39] [V] [TRT] Overriding 751 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_3d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 754 to head_3d
[11/24/2022-12:07:39] [V] [TRT] Overriding 754 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_3d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 757 to head_3d
[11/24/2022-12:07:39] [V] [TRT] Overriding 757 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_3d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 760 to head_3d
[11/24/2022-12:07:39] [V] [TRT] Overriding 760 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_3d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Eliminating concatenation node_of_head_2d
[11/24/2022-12:07:39] [V] [TRT] Retargeting 724 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 724 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 727 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 727 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Generating copy for 730 to head_2d because concat input is consumed by producer of another input.
[11/24/2022-12:07:39] [V] [TRT] Assigning 730 copy scale and zero-point 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Overriding 730 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 733 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 733 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 736 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 736 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 739 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 739 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 742 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 742 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 794 to head_2d
[11/24/2022-12:07:39] [V] [TRT] Overriding 794 scale and zero-point Quantization(scale: {0.015748,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using head_2d scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Eliminating concatenation node_of_510
[11/24/2022-12:07:39] [V] [TRT] Generating copy for i to 510 because input is not movable.
[11/24/2022-12:07:39] [V] [TRT] Assigning i copy scale and zero-point 
[11/24/2022-12:07:39] [V] [TRT] using 510 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Overriding i scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using 510 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] Retargeting 509 to 510
[11/24/2022-12:07:39] [V] [TRT] Overriding 509 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,}) 
[11/24/2022-12:07:39] [V] [TRT] using 510 scale and zero-point Quantization(scale: {0.0314961,}, zero-point: {0,})
[11/24/2022-12:07:39] [V] [TRT] After concat removal: 118 layers
[11/24/2022-12:07:39] [V] [TRT] Graph construction and optimization completed in 0.137915 seconds.
[11/24/2022-12:07:39] [I] [TRT] ---------- Layers Running on DLA ----------
[11/24/2022-12:07:39] [I] [TRT] ---------- Layers Running on GPU ----------
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONSTANT: m
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CAST: node_of_509
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] COPY: i copy
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_511 + node_of_512 + PWN(node_of_513)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_514 + node_of_515 + PWN(node_of_516)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_517 + node_of_518
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_519 + node_of_520 + PWN(node_of_521)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_522 + node_of_523 + PWN(node_of_524)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_525 + node_of_526
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_527 + node_of_528 + PWN(node_of_529)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_530 + node_of_531 + PWN(node_of_532)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_533 + node_of_534 + node_of_535
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_536 + node_of_537 + PWN(node_of_538)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_539 + node_of_540 + PWN(node_of_541)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_542 + node_of_543
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_544 + node_of_545 + PWN(node_of_546)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_547 + node_of_548 + PWN(node_of_549)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_550 + node_of_551 + node_of_552
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_553 + node_of_554 + PWN(node_of_555)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_556 + node_of_557 + PWN(node_of_558)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_559 + node_of_560 + node_of_561
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_562 + node_of_563 + PWN(node_of_564)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_565 + node_of_566 + PWN(node_of_567)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_568 + node_of_569
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_570 + node_of_571 + PWN(node_of_572)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_573 + node_of_574 + PWN(node_of_575)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_576 + node_of_577 + node_of_578
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_579 + node_of_580 + PWN(node_of_581)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_582 + node_of_583 + PWN(node_of_584)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_585 + node_of_586 + node_of_587
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_588 + node_of_589 + PWN(node_of_590)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_591 + node_of_592 + PWN(node_of_593)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_594 + node_of_595 + node_of_596
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_597 + node_of_598 + PWN(node_of_599)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_600 + node_of_601 + PWN(node_of_602)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_603 + node_of_604
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_605 + node_of_606 + PWN(node_of_607)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_608 + node_of_609 + PWN(node_of_610)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_611 + node_of_612 + node_of_613
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_614 + node_of_615 + PWN(node_of_616)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_617 + node_of_618 + PWN(node_of_619)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_620 + node_of_621 + node_of_622
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_623 + node_of_624 + PWN(node_of_625)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_626 + node_of_627 + PWN(node_of_628)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_629 + node_of_630
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_631 + node_of_632 + PWN(node_of_633)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_634 + node_of_635 + PWN(node_of_636)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_637 + node_of_638 + node_of_639
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_640 + node_of_641 + PWN(node_of_642)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_643 + node_of_644 + PWN(node_of_645)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_646 + node_of_647 + node_of_648
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_649 + node_of_650 + PWN(node_of_651)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_652 + node_of_653 + PWN(node_of_654)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_655 + node_of_656
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_657 + node_of_658 + node_of_659
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_660
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_661)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_662 + node_of_663 + node_of_664
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_665 + node_of_666 + node_of_667
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_668
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_669)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_670 + node_of_671 + node_of_672
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_673 + node_of_674 + node_of_675
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_676
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_677)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_678 + node_of_679 + node_of_680
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_681 + node_of_682 + node_of_683
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_684
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_685)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_686 + node_of_687 + node_of_688
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_689 + node_of_690 + node_of_691
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_692
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_693)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_694 + node_of_695 + node_of_696
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_697 + node_of_698 + node_of_699
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_700
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_701)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_702 + node_of_703 + node_of_704
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_705 + node_of_706 + node_of_707
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_708
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_709)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_710 + node_of_711 + node_of_712
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_713 + node_of_714 + node_of_715
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_716
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] DECONVOLUTION: node_of_717
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POINTWISE: PWN(node_of_718)
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_719 + node_of_720 + node_of_721
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_724
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_727
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_730
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_733
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_736
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_739
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_742
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_745
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_748
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_751
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_754
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_757
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_760
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_763
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_766
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_769
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_772
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_775
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_778
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_781
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_784
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_787
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_790
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] CONVOLUTION: node_of_793
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POOLING: node_of_794
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] POOLING: node_of_795
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] COPY: 730 copy
[11/24/2022-12:07:39] [I] [TRT] [GpuLayer] COPY: 787 copy
[11/24/2022-12:07:43] [V] [TRT] Using cublasLt as a tactic source
[11/24/2022-12:07:43] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +813, now: CPU 1304, GPU 5896 (MiB)
[11/24/2022-12:07:43] [V] [TRT] Using cuDNN as a tactic source
[11/24/2022-12:07:44] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +84, GPU +133, now: CPU 1388, GPU 6029 (MiB)
[11/24/2022-12:07:44] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
[11/24/2022-12:07:44] [V] [TRT] Constructing optimization profile number 0 [1/1].
[11/24/2022-12:07:44] [V] [TRT] Reserving memory for activation tensors. Host: 0 bytes Device: 9461760 bytes
[11/24/2022-12:07:44] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.291749
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.744471
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.294066
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1000 Time: 0.291749
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.579918
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.709833
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.583721
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1000 Time: 0.579918
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 13.5543
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 1.26729
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 4.94822
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1002 Time: 1.26729
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.459497
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.243726
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.866537
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.243726
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.0385246
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.048224
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.0616762
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1000 Time: 0.0385246
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.0569859
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.133806
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.0335278
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 0 Time: 0.0335278
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.199986
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.12061
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.0797349
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 0 Time: 0.0797349
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.384398
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.226642
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.387342
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.226642
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 4.34687
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.448416
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 4.29807
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.448416
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 0.739182
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.221531
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 0 Time: 0.746181
[11/24/2022-12:07:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.221531
[11/24/2022-12:07:44] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:44] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1000 Time: 8.66818
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:44] [V] [TRT] Tactic: 1002 Time: 0.529943
[11/24/2022-12:07:44] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 8.79925
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.529943
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0377303
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.0402023
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.0163901
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0163901
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.215378
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.211904
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.211986
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.211904
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,236544,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.211008
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.211008
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0279162
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.61093
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.0291173
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.0279162
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.124361
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.605134
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.121984
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.121984
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 2.69866
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.610862
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 2.7376
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.610862
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.32091
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 4.2331
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.319904
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.319904
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.026835
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.276119
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.0265059
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0265059
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0302894
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.0403543
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.0310418
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.0302894
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.13347
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.299328
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.134041
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.13347
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.268773
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.300146
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.267579
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.267579
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 4.36398
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.251561
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 3.04145
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.251561
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.594181
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 8.46514
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.617467
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.594181
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 6.0667
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 8.47884
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 6.07291
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 6.0667
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0339657
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.0379657
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.033739
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.033739
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.170898
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.236864
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.173595
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.170898
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,1344,2) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.166606
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.166606
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0532282
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.582139
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.0498149
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0498149
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.039768
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.558318
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.03972
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.03972
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 2.19855
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.575616
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 2.26558
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.575616
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.377339
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 4.05905
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.388549
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.377339
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0348306
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.273111
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.035944
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1000 Time: 0.0348306
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.0602484
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.0421257
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.072064
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.0421257
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.142245
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.295515
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.141538
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.141538
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.259419
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.294441
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.259237
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.259237
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 3.05163
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 0.253248
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 3.06169
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.253248
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 0.641056
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 8.48891
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 0 Time: 0.565998
[11/24/2022-12:07:45] [V] [TRT] Fastest Tactic: 0 Time: 0.565998
[11/24/2022-12:07:45] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:45] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1000 Time: 6.12135
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:45] [V] [TRT] Tactic: 1002 Time: 8.48893
[11/24/2022-12:07:45] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 6.10655
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 6.10655
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.0610225
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.0413554
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.0750103
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.0413554
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.240151
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.25243
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.232439
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.232439
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.236978
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.236978
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.10987
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.582807
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.110213
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.10987
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.0629531
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.559703
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.0630278
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.0629531
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.153125
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.574121
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.150501
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.150501
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.475511
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 4.05839
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.430258
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.430258
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.106471
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.277083
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.105881
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.105881
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.124039
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.0624625
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.123296
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.0624625
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.174638
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.294743
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.173541
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.173541
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.309298
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.295328
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.309975
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.295328
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 3.45074
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.252311
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 3.33964
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.252311
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.813586
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 8.48976
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.743264
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.743264
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 6.34955
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 8.49054
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 6.26354
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 6.26354
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.122736
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.274359
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.123422
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.122736
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.321737
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 0.260677
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.31525
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1002 Time: 0.260677
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.322011
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.322011
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.0561021
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 1.14505
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.0563444
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.0561021
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.0564998
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 3.95649
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.0564069
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 0 Time: 0.0564069
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 0.139653
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1002 Time: 4.04753
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 0 Time: 0.146592
[11/24/2022-12:07:46] [V] [TRT] Fastest Tactic: 1000 Time: 0.139653
[11/24/2022-12:07:46] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:46] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:46] [V] [TRT] Tactic: 1000 Time: 2.15001
[11/24/2022-12:07:46] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 36.2039
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 2.24688
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 2.15001
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0515322
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.538002
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0516069
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.0515322
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0667246
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 8.4456
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0638049
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0638049
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.162862
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 8.48654
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.164151
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.162862
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.285819
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 8.47811
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.28821
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.285819
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 3.09179
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 8.47844
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 3.08824
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 3.08824
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.284631
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.577591
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.282674
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.282674
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 6.11978
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.493115
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 6.12192
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.493115
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0664503
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.0664503
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.239703
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.239703
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.23867
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.494176
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.234894
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.234894
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0217842
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.0259794
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0336585
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.0217842
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0286208
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.269179
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.028547
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.028547
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0726423
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.279424
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0678507
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0678507
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 2.20366
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.245765
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 2.35968
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.245765
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.291566
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.552416
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.296366
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.291566
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0289481
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.030859
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0174303
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0174303
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0995589
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.0637867
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0459051
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0459051
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.212951
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.096432
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.212389
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.096432
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 3.00968
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.171543
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 3.00293
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.171543
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.568677
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.120752
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.591136
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.120752
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 6.06008
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.334592
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 6.00783
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.334592
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0352393
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.0312293
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0352375
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.0312293
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.143127
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.199209
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.141186
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.141186
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(473088,236544,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.140558
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.140558
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0311899
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.268608
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.016159
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.016159
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0320512
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.276219
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0320119
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 0 Time: 0.0320119
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.0658789
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.288192
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 0.0707017
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1000 Time: 0.0658789
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 2.19627
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1002 Time: 0.261655
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 0 Time: 2.28873
[11/24/2022-12:07:47] [V] [TRT] Fastest Tactic: 1002 Time: 0.261655
[11/24/2022-12:07:47] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:47] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:47] [V] [TRT] Tactic: 1000 Time: 0.280626
[11/24/2022-12:07:47] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 8.3431
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.302587
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.280626
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0291346
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.830478
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.0157006
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0157006
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.100743
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.295291
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.0391086
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0391086
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.210848
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.295566
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.213289
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.210848
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 1.4959
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.253627
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 1.52357
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.253627
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.57109
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 8.29735
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.523369
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.523369
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 6.02965
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 26.0428
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 6.01966
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 6.01966
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0214047
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.238418
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.0215321
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.0214047
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0714834
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.20208
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.07232
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.0714834
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:2,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.137161
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.137161
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0453829
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.273669
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.0369006
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0369006
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0406114
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.285847
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.0405954
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0405954
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.112411
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.304983
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.115269
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.112411
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 2.32874
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.294501
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 2.39373
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.294501
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.364037
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 8.34953
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.373778
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1000 Time: 0.364037
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0345426
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.84336
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.03184
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.03184
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.0467326
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.28379
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.0290715
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.0290715
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.256119
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.295598
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.254117
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.254117
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 3.0554
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 0.254007
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 3.06601
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.254007
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 0.664553
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1002 Time: 8.33768
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 0 Time: 0.617861
[11/24/2022-12:07:48] [V] [TRT] Fastest Tactic: 0 Time: 0.617861
[11/24/2022-12:07:48] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:48] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:48] [V] [TRT] Tactic: 1000 Time: 6.03695
[11/24/2022-12:07:48] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 26.0408
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 6.03234
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 6.03234
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.0646994
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.239264
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.0627017
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0627017
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.230587
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.202409
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.232457
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.202409
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.235278
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 0.235278
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.0958697
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.274368
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.0967611
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 0.0958697
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.05664
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.287552
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.0564663
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0564663
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.138368
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.306135
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.136489
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.136489
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 2.40101
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.294962
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 2.457
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.294962
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.394651
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 8.35565
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.394153
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.394153
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.0933234
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.844677
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.0922857
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0922857
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.115385
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.284709
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.115509
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 0.115385
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.161824
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.295438
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.162711
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 0.161824
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 3.085
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.253458
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 3.09938
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.253458
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.682843
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 8.36884
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.665874
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.665874
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 6.09029
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 26.0393
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 6.11665
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 6.09029
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.114971
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.239365
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.115616
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 0.114971
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.281275
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.202491
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.282601
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1002 Time: 0.202491
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.282377
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 1000 Time: 0.282377
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.141198
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.273591
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.140715
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.140715
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.077392
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.290784
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.0773851
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.0773851
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1000 Time: 0.164091
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 1002 Time: 0.309216
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:49] [V] [TRT] Tactic: 0 Time: 0.163177
[11/24/2022-12:07:49] [V] [TRT] Fastest Tactic: 0 Time: 0.163177
[11/24/2022-12:07:49] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:49] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:49] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 1.94731
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.300023
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 2.16544
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.300023
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.478203
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 8.35348
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.452453
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.452453
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.140229
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.845294
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.139776
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.139776
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.0739474
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.284997
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.0738857
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0738857
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.185317
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.295945
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.185166
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.185166
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.310793
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.29563
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.309664
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1002 Time: 0.29563
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.698642
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 8.36847
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.755634
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 0.698642
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 6.17256
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 26.044
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 6.19483
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 6.17256
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.081824
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.239314
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.0820823
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 0.081824
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.165947
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.202962
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.166615
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 0.165947
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.340133
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 0.340133
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.0567619
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.535035
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.0559269
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0559269
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.0564526
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 8.30752
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.05648
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 0.0564526
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.145943
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 8.34313
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.13933
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.13933
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 2.32627
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 8.34319
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 2.42591
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 1000 Time: 2.32627
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.213394
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 0.600686
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.211666
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.211666
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.051616
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1002 Time: 1.68011
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 0 Time: 0.0515291
[11/24/2022-12:07:50] [V] [TRT] Fastest Tactic: 0 Time: 0.0515291
[11/24/2022-12:07:50] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:50] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:50] [V] [TRT] Tactic: 1000 Time: 0.0653912
[11/24/2022-12:07:50] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 12.5654
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.0661029
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.0653912
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.162487
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 8.33018
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.163991
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.162487
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.284174
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 13.0237
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.28256
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 0 Time: 0.28256
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 3.04655
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 26.0264
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 3.0635
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 3.04655
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 6.03031
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 0.495909
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 6.11148
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1002 Time: 0.495909
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.0688061
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.0688061
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.241179
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.241179
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(1:8,236544,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.236311
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 0.392658
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.238857
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.236311
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.141029
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 0.53552
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.141438
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.141029
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.140439
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 8.31529
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.141147
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.140439
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.22331
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 8.34822
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.226798
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.22331
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 2.10439
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 8.35084
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 2.181
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 2.10439
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.310857
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 0.605211
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.308261
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 0 Time: 0.308261
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.139762
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1002 Time: 1.68088
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 0 Time: 0.139877
[11/24/2022-12:07:51] [V] [TRT] Fastest Tactic: 1000 Time: 0.139762
[11/24/2022-12:07:51] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:51] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:51] [V] [TRT] Tactic: 1000 Time: 0.155703
[11/24/2022-12:07:51] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 12.5737
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.155707
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.155703
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.251205
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 8.35967
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.25024
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 0 Time: 0.25024
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.380379
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 13.0268
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.380603
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.380379
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 3.19045
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 26.0333
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 3.23292
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 3.19045
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.381486
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.579378
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.378853
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 0 Time: 0.378853
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.156183
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.156183
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.341207
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.341207
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Half(473088:32,236544,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.340306
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.391858
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.337824
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 0 Time: 0.337824
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0344887
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.453198
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0175589
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 0 Time: 0.0175589
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0353856
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.0399223
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0355255
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0353856
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0735177
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.041352
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0736846
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.041352
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 2.20764
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.251232
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 2.2342
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.251232
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.277381
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.277381
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0346898
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.466368
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0348837
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0346898
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0204134
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.23968
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0206204
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0204134
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.105259
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.247945
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.105561
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.105259
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.210674
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.248283
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.214025
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.210674
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 1.52728
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.205966
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 1.52927
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.205966
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.61003
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.61003
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 6.06815
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 6.06815
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0736914
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.306537
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0761966
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0736914
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:4,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.141984
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.141984
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0960069
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.459753
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0963657
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0960069
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0580678
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.250043
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0569859
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 0 Time: 0.0569859
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.138494
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.26821
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.141707
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.138494
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 2.2627
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.260466
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 2.33605
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.260466
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.415584
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.415584
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0928389
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.470272
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0933851
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0928389
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.0525745
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.242725
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0529783
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1000 Time: 0.0525745
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.162962
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.247854
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.0884823
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 0 Time: 0.0884823
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 0.283698
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.248549
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 0 Time: 0.28549
[11/24/2022-12:07:52] [V] [TRT] Fastest Tactic: 1002 Time: 0.248549
[11/24/2022-12:07:52] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:52] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1000 Time: 1.5775
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:52] [V] [TRT] Tactic: 1002 Time: 0.20576
[11/24/2022-12:07:52] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 1.57812
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.20576
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.666478
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.666478
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 6.07746
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 6.07746
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0630415
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.325079
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0509867
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0509867
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Int8(473088:32,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.285979
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.285979
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Float(473088,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.09672
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.09672
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Float(473088,1,1344,2) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0966949
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.0966949
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Float(236544,1:4,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.183109
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.183109
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.31739
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 2.31739
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.258121
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.522853
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.256393
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.256393
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(473088,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0933394
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.0933394
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(236544,236544:2,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.115925
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.115925
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.206039
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.206039
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.325211
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.325211
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 3.35696
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 3.35696
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(1:8,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.325285
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.485262
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.17227
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.17227
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Half(473088:32,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 6.3052
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.399305
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 6.3424
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.399305
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Int8(236544,236544:4,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.115993
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.115993
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Int8(473088:32,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat((Unnamed Layer* 0) [Constant]_output -> <out>) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.282848
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.282848
[11/24/2022-12:07:53] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0623924
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.0722971
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0609935
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0609935
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.176352
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.255899
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.166693
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.166693
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.23202
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.594185
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 2.05412
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.594185
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.309883
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.123947
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.318962
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.123947
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0223824
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.0308288
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.022046
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.022046
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0424366
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.073584
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0411417
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0411417
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0913897
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.0768069
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0905829
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.0768069
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.203214
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.145691
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.205577
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.145691
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.77786
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.29483
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 2.75901
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.29483
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0361189
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.232631
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0346295
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0346295
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.153408
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.233211
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.147895
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.147895
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.026272
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.582066
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0269897
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.026272
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.168119
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.564192
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.166578
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.166578
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.14253
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.580453
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 2.13655
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.580453
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.303552
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 4.05755
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.319694
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.303552
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0268099
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.273952
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0263924
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0263924
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0400846
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.0401349
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0404343
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.0400846
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0887749
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.288901
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0874171
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0874171
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.199881
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.288352
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.201998
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.199881
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.77776
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.299259
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 2.77685
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.299259
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0344942
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.251328
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0340498
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0340498
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.161888
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.268379
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.159721
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.159721
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0442126
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.582057
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0426926
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0426926
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0924571
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.560576
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0932457
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.0924571
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.190976
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.576677
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.187977
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.187977
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.20482
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.582949
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 2.20946
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.582949
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.363767
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 4.05791
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.356832
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.356832
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0338057
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.272887
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0352969
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.0338057
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0688991
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.0483566
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.069501
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.0483566
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.112814
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.291813
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.112896
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.112814
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.230647
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.293842
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.231442
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.230647
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 2.79155
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.298857
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 2.81823
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.298857
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.0653059
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.270907
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.0636114
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.0636114
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.231685
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.282793
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.226295
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 0 Time: 0.226295
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.110359
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.582318
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 0 Time: 0.110363
[11/24/2022-12:07:53] [V] [TRT] Fastest Tactic: 1000 Time: 0.110359
[11/24/2022-12:07:53] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:53] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1000 Time: 0.120926
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:53] [V] [TRT] Tactic: 1002 Time: 0.560686
[11/24/2022-12:07:53] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.121077
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1000 Time: 0.120926
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.259451
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.573632
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.247278
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.247278
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 1.82557
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.580485
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 1.88766
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.580485
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.427255
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 4.05779
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.470405
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1000 Time: 0.427255
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.106725
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.277586
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.106697
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.106697
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.139655
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.07312
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.140446
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.07312
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.155328
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.291895
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.152553
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.152553
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.284219
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.294629
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.284174
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.284174
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 3.15972
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.306565
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 3.07243
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.306565
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.123168
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.278825
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.123129
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.123129
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.317655
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.292763
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.318464
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1002 Time: 0.292763
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.0565196
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 1.14505
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.0561722
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.0561722
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.11653
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 3.95585
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.115102
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.115102
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.217751
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 3.96838
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.213586
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.213586
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 1.95644
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 36.2077
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 2.03093
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1000 Time: 1.95644
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.051584
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 0.537819
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.0520107
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1000 Time: 0.051584
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.0740549
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 8.45466
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.0756251
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1000 Time: 0.0740549
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.140206
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 8.4749
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.141074
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 1000 Time: 0.140206
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 0.261298
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1002 Time: 8.46355
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 0 Time: 0.260457
[11/24/2022-12:07:54] [V] [TRT] Fastest Tactic: 0 Time: 0.260457
[11/24/2022-12:07:54] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:54] [V] [TRT] Tactic: 1000 Time: 2.85364
[11/24/2022-12:07:54] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 8.46605
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 2.86732
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 2.85364
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0770423
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.0770423
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 509) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.238423
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.238423
[11/24/2022-12:07:55] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0363063
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0487284
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0389211
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.0363063
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0887337
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0976868
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0915566
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.0887337
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.131595
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.115102
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.133817
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.115102
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.266843
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.153317
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.267141
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.153317
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.155369
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.20907
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.148375
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.148375
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0220454
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0450263
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0172648
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0172648
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0516983
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0761326
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0506621
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0506621
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0715398
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0807017
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0763703
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.0715398
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.130729
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.112023
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.131897
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.112023
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.277902
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.125319
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.274757
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.125319
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0503055
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0409611
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0504503
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.0409611
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(709632,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: i copy (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.231529
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.23179
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.227378
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.227378
[11/24/2022-12:07:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:07:55] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0833486
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.258569
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0829486
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0829486
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.227346
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.261413
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.227547
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.227346
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0666423
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0610499
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0949189
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.0610499
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0882629
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.0789257
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0707642
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0707642
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.136583
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.069152
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0538133
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0538133
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.259598
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.126763
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.261102
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.126763
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 3.07807
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.253518
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 3.02217
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.253518
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.093184
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.245733
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0452389
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0452389
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.372379
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.20357
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.373723
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.20357
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.14104
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.596315
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.151291
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.14104
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.215355
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.585998
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.214455
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.214455
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.133488
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.284297
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.121269
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.121269
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.186254
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.296823
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.202048
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.186254
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.132729
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.299241
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.134809
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.132729
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.250651
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.299968
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.254085
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.250651
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 3.19427
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.258071
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 3.17202
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.258071
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.20315
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.256887
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.193851
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.193851
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(1182720,1,3360,5) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.600878
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.24565
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.599195
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.24565
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.225573
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.598377
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.227287
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.225573
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0855017
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.600649
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0857234
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.0855017
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.219831
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.286373
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.219515
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.219515
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.283013
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.299401
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.282821
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.282821
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.149161
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.302999
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.151273
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.149161
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.27104
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.302802
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.273234
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.27104
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 3.27098
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.26016
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 3.29427
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.26016
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.278085
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.349509
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.273426
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.273426
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,1344,2) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.677577
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.304256
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.684416
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.304256
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.264736
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.598546
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.264667
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.264667
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.0893646
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.604119
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.0887063
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.0887063
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.251383
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.606281
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.250414
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.250414
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.254825
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.288859
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.254839
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1000 Time: 0.254825
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.316027
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.301138
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.316338
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.301138
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.166167
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.304082
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.163721
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.163721
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.289193
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.301833
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.288855
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 0 Time: 0.288855
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 3.7034
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.258619
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 3.56368
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.258619
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.298203
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.282194
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 0 Time: 0.297221
[11/24/2022-12:07:55] [V] [TRT] Fastest Tactic: 1002 Time: 0.282194
[11/24/2022-12:07:55] [V] [TRT] *************** Autotuning Reformat: Float(236544,236544:32,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:55] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1000 Time: 0.784887
[11/24/2022-12:07:55] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:55] [V] [TRT] Tactic: 1002 Time: 0.271077
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.769829
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.271077
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.129975
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 2.84844
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.130395
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.129975
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.131648
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 3.96867
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.131687
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.131648
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.301317
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 4.03939
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.297083
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.297083
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.118174
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 1.33325
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.119008
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.118174
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.164978
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 8.52259
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.164983
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.164978
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.211927
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 8.53432
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.21227
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.211927
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.337362
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 8.50219
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.335529
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.335529
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 3.15251
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 8.48581
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 3.17311
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 3.15251
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.172937
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.172937
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Float(1:4,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.576608
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.576608
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.069792
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.0612983
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0842629
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.0612983
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.078656
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.279168
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0791886
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.078656
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.20501
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.28224
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.209449
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.20501
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0849326
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.0749006
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0686659
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0686659
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.125211
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.0648945
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0494278
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0494278
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.23269
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.0975749
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.238798
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.0975749
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 3.01072
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.173179
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 3.00668
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.173179
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0824526
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.237559
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.084624
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.0824526
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(1182720,236544,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.331904
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.199296
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.331099
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.199296
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0778217
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.280247
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0527893
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0527893
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0832526
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.293042
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0847063
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.0832526
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.209161
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.295566
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.215621
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.209161
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0711345
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.853024
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0465029
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0465029
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.129456
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.301691
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0502446
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0502446
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.24107
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.302007
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.246199
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.24107
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 3.02196
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.260558
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 3.01845
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.260558
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0980251
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.246926
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.09664
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.09664
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(709632,236544:2,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.342263
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.208265
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.348594
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1002 Time: 0.208265
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.105515
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.286958
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0503863
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0503863
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0826674
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.30309
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0837006
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 1000 Time: 0.0826674
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.212293
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.303013
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.211927
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.211927
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.0805394
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1002 Time: 0.84656
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 0 Time: 0.0387829
[11/24/2022-12:07:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0387829
[11/24/2022-12:07:56] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:56] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:56] [V] [TRT] Tactic: 1000 Time: 0.151099
[11/24/2022-12:07:56] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.305431
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0409726
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0409726
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.248489
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.308846
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.250491
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.248489
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 3.13355
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.265312
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 3.13217
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.265312
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.1528
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.248096
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.147095
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.147095
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.570368
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.208059
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.574496
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.208059
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.22565
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.287145
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.226299
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.22565
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.0871086
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.306226
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.086976
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.086976
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.235525
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.302661
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.235296
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.235296
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.219369
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.846103
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.219634
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.219369
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.280763
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.305047
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.283465
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.280763
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.148398
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.309486
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.147301
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.147301
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 3.27943
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.265531
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 3.28128
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.265531
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.278085
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.247963
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.273326
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.247963
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:16,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.693998
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.207922
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.689682
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.207922
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.340928
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.287963
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.342208
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.287963
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.0954766
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.315886
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0953234
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0953234
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.25819
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.303575
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.258382
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.25819
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.341696
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.848791
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.341056
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.341056
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.388306
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.305723
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.391186
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.305723
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.170601
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.308617
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.168261
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.168261
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.291227
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.308585
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.291195
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.291195
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.377929
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.247913
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.380608
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.247913
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Half(236544,236544:32,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.792736
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.20832
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.807598
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.20832
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.0833166
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.508215
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0461714
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0461714
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.0883291
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.256923
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0900343
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.0883291
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.194555
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.355872
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.19995
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.194555
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.08096
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.472439
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0814217
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.08096
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.104475
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.249527
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.103063
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.103063
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.135536
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.25067
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.137461
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.135536
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.223895
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.250706
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.231227
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.223895
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 3.00789
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.209888
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 2.99623
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.209888
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(473088,236544:4,672,1) -> Int8(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.348366
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.305705
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.090464
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.090464
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.225824
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.498254
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.227973
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.225824
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.0937486
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.283525
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0940297
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.0937486
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.237147
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.350688
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.238994
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.237147
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(1182720,236544,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.22
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.475675
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.220206
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.22
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(709632,236544:2,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.282702
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.249673
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.282738
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.249673
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,1:8,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.153161
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.250331
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0872594
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0872594
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,1:16,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.275008
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.251141
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.274587
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.251141
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Half(236544,236544:32,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 3.27163
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.208169
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 3.27164
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.208169
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Int8(236544,236544:32,672,1) -> Int8(473088,236544:4,672,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(510 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.277815
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.342254
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.093872
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.093872
[11/24/2022-12:07:57] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.184763
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.158885
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.186075
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.158885
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.18645
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.158816
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.186793
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.158816
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.102347
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.0933897
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.147351
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.0933897
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.120853
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.113374
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0939794
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0939794
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.185253
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.0732092
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0675931
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0675931
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.185115
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.0732823
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.185088
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.0732823
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.714299
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.076016
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.715195
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.076016
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.132599
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.0649981
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.0557074
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 0 Time: 0.0557074
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.390491
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.0650362
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.40576
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.0650362
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.417691
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.15877
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.418702
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.15877
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.127152
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.157906
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.127218
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1000 Time: 0.127152
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.402597
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.0839634
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.401929
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.0839634
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.469623
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.110139
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 0 Time: 0.472018
[11/24/2022-12:07:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.110139
[11/24/2022-12:07:57] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:57] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1000 Time: 0.123335
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:57] [V] [TRT] Tactic: 1002 Time: 0.070013
[11/24/2022-12:07:57] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.123367
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.070013
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.12352
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0695985
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.123573
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0695985
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.24273
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0703131
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.24837
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0703131
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.470034
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0685516
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.468901
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0685516
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.20729
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0679467
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.20804
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0679467
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.417797
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.158121
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.418222
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.158121
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.126981
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.158071
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.126891
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.126891
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.402135
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0840297
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.402565
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0840297
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.470688
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.111088
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.470798
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.111088
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.143072
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0697935
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.142841
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0697935
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.143296
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0699169
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.143042
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0699169
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.23557
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0700312
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.23114
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0700312
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.470583
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.076944
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.468018
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.076944
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.20197
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0769326
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.20872
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0769326
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.4168
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.159113
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.418738
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.159113
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.125865
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.157979
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.126674
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1000 Time: 0.125865
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.143712
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.157618
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.143058
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.143058
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.402843
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.084912
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.402377
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.084912
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.470839
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.110471
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.471081
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.110471
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.142862
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0695878
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.143625
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0695878
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.143346
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0704244
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.143703
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0704244
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.24956
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0696564
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.23406
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0696564
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.468937
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0700084
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.470537
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0700084
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.20411
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0705432
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.20244
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0705432
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.107239
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0939269
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.131657
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0939269
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.173691
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0748183
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.172448
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0748183
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.175886
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0745189
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.175067
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0745189
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.112875
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0647512
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0916777
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0647512
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.168603
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0542766
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0586011
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0542766
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.16848
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0544899
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.169207
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0544899
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.689952
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0538088
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.679502
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0538088
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.133929
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0683779
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.135358
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0683779
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.303931
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0591939
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.257897
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0591939
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.118622
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0859474
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0795726
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0795726
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.140283
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.079664
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.139641
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.079664
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.150898
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0796137
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.149637
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0796137
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.108304
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.287794
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0720777
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0720777
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.1364
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0732526
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0593326
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0593326
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.136222
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0727931
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.136219
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0727931
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.363593
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.073024
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.353705
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.073024
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.0761783
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0700053
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0759406
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0700053
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.163406
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0603322
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.185074
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0603322
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.185317
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0779931
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0672777
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0672777
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.126619
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0699886
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.127349
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0699886
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.144256
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0698286
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.14549
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0698286
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.310766
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.250981
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0479436
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0479436
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.286647
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.101209
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.0471943
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.0471943
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.134889
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0634484
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.13467
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0634484
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.16918
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0635459
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.20138
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0635459
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.229563
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0600091
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.326363
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0600091
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.17309
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0485836
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.05275
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0485836
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.233883
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0774583
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.231543
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0774583
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.127392
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0695284
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.127362
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0695284
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.14485
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0701135
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.145641
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0701135
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.194208
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.245061
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.183543
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.183543
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.343081
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.100816
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.272407
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.100816
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.134789
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0635109
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.134439
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0635109
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.19894
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0635931
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.13083
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0635931
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.225545
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0595855
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.236667
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0595855
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 1.15365
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0487543
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 1.00226
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0487543
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.261083
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0779794
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.224407
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0779794
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.127026
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.072528
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.127081
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.072528
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.144805
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.069277
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.144704
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.069277
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.228064
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.237029
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.13232
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 0 Time: 0.13232
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.113696
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.101424
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.119593
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.101424
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.134571
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0634103
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.134807
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0634103
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.134025
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.063203
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.134889
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.063203
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.149563
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0591025
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.159305
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0591025
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.522496
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.0501531
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 0 Time: 0.523799
[11/24/2022-12:07:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.0501531
[11/24/2022-12:07:58] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:58] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1000 Time: 0.128073
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:58] [V] [TRT] Tactic: 1002 Time: 0.137301
[11/24/2022-12:07:58] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.069571
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.069571
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.143022
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.06688
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.141762
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.06688
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.158825
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0801989
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.158583
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0801989
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.127605
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.157019
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.127104
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.127104
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0704152
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0716571
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0710552
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0704152
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.155607
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0599512
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.155602
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0599512
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.155858
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0601234
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.156361
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0601234
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.348238
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0604434
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.343369
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0604434
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.190706
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0785989
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0321371
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0321371
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.126626
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.13517
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.127387
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.126626
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.137925
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.066016
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.138313
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.066016
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.157605
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0763177
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.157298
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0763177
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.125808
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.154208
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.125529
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.125529
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0691109
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0616671
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0690347
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0616671
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.156137
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0505432
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0361246
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0361246
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.155502
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0502202
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.157001
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0502202
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.410368
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0502781
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.431186
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0502781
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(513 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0486888
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0787337
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0201177
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0201177
[11/24/2022-12:07:59] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,59136,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1,10752,32) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(473088,1:4,2688,8) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(1892352,59136,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136:2,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(236544,1:8,1344,4) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:16,672,2) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(473088,59136:4,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0705432
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0674545
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.07144
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0674545
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0745349
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0678522
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0742697
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0678522
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0520838
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.050464
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0773189
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.050464
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0627855
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0446034
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.050077
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0446034
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0671147
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0409783
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0322953
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0322953
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0685867
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0390834
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0676251
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0390834
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.654811
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0701272
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.691383
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0701272
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.068064
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0693516
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0223582
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0223582
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,59136,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.162277
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0580983
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.151237
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0580983
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.171973
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.156343
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.130905
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.130905
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0670248
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.15739
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0669029
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0669029
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.11259
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0780411
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0711726
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0711726
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0785486
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0808046
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.13912
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0785486
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0652861
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0819886
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0656168
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0652861
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0652815
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0816571
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0655619
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0652815
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.980512
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0716869
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.978213
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0716869
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.1384
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0696762
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.102272
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0696762
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(946176,1,5376,16) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.614839
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0683322
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.578651
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0683322
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0952206
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.156617
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0954606
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0952206
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0668602
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.15755
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0668602
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0668602
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0923954
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0781257
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.163511
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0781257
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.145824
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0808434
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.109285
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0808434
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0748937
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0806903
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0750834
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0748937
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.074592
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0821029
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0752206
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.074592
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.965751
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0717394
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.993385
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0717394
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.114226
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0934789
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0850469
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0850469
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(236544,1:4,1344,4) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.524521
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0834331
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.624485
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0834331
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.213097
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.156873
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.213079
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.156873
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0668023
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.158089
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0665966
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0665966
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0750469
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.157385
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0749394
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0749394
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.205143
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.079232
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.204475
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.079232
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.239557
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0812274
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.239845
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0812274
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0751406
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0814126
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0751109
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0751109
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0751863
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0818126
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0750994
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0750994
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 1.08023
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0715177
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 1.05348
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0715177
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.240146
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0766651
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.239063
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0766651
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Float(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.615895
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0742194
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.622464
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0742194
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0570118
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0508617
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0689874
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0508617
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0704762
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0764914
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0694842
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0694842
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0722217
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0772046
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0725189
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0722217
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.054627
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0349888
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0391417
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0349888
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0610377
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0295369
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.027229
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.027229
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0617539
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0286423
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0614842
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0286423
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.638094
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0514133
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.651881
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0514133
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0655939
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.065155
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0655284
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.065155
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(946176,59136,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.126903
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0556861
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.121694
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0556861
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0625844
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.077744
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0401337
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0401337
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0694339
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0805486
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0695253
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0694339
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.077008
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0807634
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0767474
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0767474
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0540221
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.220992
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0275139
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0275139
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0661318
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0807086
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0163611
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0163611
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0693379
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0805349
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.06896
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.06896
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.307675
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0710217
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.321403
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0710217
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0373589
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0675398
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0372286
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0372286
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(473088,59136:2,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0693897
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0593112
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0676937
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0593112
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0661333
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0781303
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0357303
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0357303
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0670583
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0814629
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0669562
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0669562
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0759474
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0814331
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0756983
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0756983
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0578834
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.218578
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.013888
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.013888
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0623604
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0793966
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.012883
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.012883
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0674636
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0802469
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0682971
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0674636
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.750555
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0723863
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.782153
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0723863
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0755749
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0676648
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0754034
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0676648
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(118272,1:8,672,2) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.140139
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0571459
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.236887
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0571459
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0664046
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0783017
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0664183
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0664046
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0671863
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.07616
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0668297
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0668297
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0759931
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0812891
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0760503
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0759931
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0572876
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.213257
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0577371
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0572876
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0629836
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0788274
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0624015
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0624015
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0671954
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.081424
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0675855
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0671954
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.778107
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0722309
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.795195
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0722309
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0757989
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0669318
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0752731
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0669318
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:16,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.186496
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.058429
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.234533
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.058429
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.105934
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0781897
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.147113
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0781897
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0668556
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0831726
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0667292
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0667292
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0763063
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.081536
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0757463
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0757463
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0788823
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.21845
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0687055
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0687055
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0426766
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0819497
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0546575
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.0426766
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0710446
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0829509
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0708693
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0708693
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0708206
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0828686
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0707703
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0707703
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0489021
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0686461
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0461474
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0461474
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Half(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.276713
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0592168
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.299163
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0592168
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0661135
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.13139
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0337573
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0337573
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0740114
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0677135
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0724777
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1002 Time: 0.0677135
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.082112
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.0949966
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0826011
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 1000 Time: 0.082112
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0644724
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1002 Time: 0.12648
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 0 Time: 0.0640366
[11/24/2022-12:07:59] [V] [TRT] Fastest Tactic: 0 Time: 0.0640366
[11/24/2022-12:07:59] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:07:59] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:07:59] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:07:59] [V] [TRT] Tactic: 1000 Time: 0.0360583
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0685227
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.035848
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.035848
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0776114
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0676419
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0772343
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.0676419
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0774766
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0681036
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0773509
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.0681036
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.291461
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0605973
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.308983
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.0605973
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(236544,59136:4,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0967131
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0785943
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0155241
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0155241
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0666133
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.132393
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0670994
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1000 Time: 0.0666133
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0731771
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0766286
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0736663
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1000 Time: 0.0731771
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0828846
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0949897
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0826469
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0826469
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0653775
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.130251
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0653821
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1000 Time: 0.0653775
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0367417
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.072336
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0366103
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0366103
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0778446
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0704838
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.017597
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.017597
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0788731
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0711878
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0788023
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.0711878
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.371433
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.062141
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.39467
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.062141
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Int8(59136,59136:32,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(518 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.0267482
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.0880503
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.0198749
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.0198749
[11/24/2022-12:08:00] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.891095
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.293051
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.886313
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.293051
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.881266
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.293349
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.877061
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.293349
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.291799
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.264974
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.427031
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.264974
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.347621
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.326286
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.268073
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.268073
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.903351
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.201015
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.334299
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.201015
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.902816
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.201321
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.90581
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.201321
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 2.232
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.207831
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 2.2283
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.207831
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.38352
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.172718
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.155374
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 0 Time: 0.155374
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,59136,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.41783
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.173335
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.40593
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.173335
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.37435
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.323205
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.66981
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.323205
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.364704
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.27755
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.364315
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.27755
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.65095
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.237097
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.48744
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.237097
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.71901
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.325897
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.64913
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.325897
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.357193
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.190642
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.357701
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.190642
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.356576
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.190482
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.357111
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.190482
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 3.6886
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.190382
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 3.64245
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.190382
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.75577
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.178446
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.69208
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.178446
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(5677056,1,32256,96) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 3.13765
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.181755
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 3.16698
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.181755
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.42043
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.322359
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.54748
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.322359
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.36613
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.277723
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.366437
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.277723
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.54785
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.237595
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.44358
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.237595
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 1.69791
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.32507
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 1.7822
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.32507
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.415566
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.19077
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.41579
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.19077
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 0.416384
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1002 Time: 0.19024
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 0 Time: 0.415419
[11/24/2022-12:08:00] [V] [TRT] Fastest Tactic: 1002 Time: 0.19024
[11/24/2022-12:08:00] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:00] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:00] [V] [TRT] Tactic: 1000 Time: 3.64538
[11/24/2022-12:08:00] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.192763
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 3.67019
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.192763
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.71909
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.208069
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.72349
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.208069
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1:4,8064,24) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 3.17234
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.208919
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 3.19073
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.208919
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.21872
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.321742
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.23895
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.321742
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.373472
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.278542
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.37424
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.278542
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.420462
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.277417
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.419342
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.277417
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.1907
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.232233
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.1903
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.232233
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.3913
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.319529
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.39193
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.319529
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.416603
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.190912
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.416389
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.190912
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.416517
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.190757
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.416978
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.190757
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 3.74444
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.191374
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 3.68645
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.191374
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.38497
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.187305
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.38374
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.187305
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Float(177408,59136:32,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 3.5901
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.187118
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 3.61835
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.187118
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.309463
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.265486
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.383785
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.265486
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.753243
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.205838
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.750208
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.205838
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.742039
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.206437
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.745536
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.206437
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.325906
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.176759
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.264105
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.176759
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.79632
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.146153
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.326336
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.146153
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.790373
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.146423
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.797568
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.146423
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.98683
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.143397
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.99768
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.143397
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.393339
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.191433
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.392667
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.191433
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(5677056,59136,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.11383
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.161797
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.10841
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.161797
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.342574
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.237609
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.227474
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 0 Time: 0.227474
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.520402
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.215657
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.519799
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.215657
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.553454
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.217979
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.553047
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.217979
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.311054
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 1.15333
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.204782
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 0 Time: 0.204782
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.560352
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.202386
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.282665
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.202386
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.560352
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.202898
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 0.560224
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.202898
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 1.07703
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.200951
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 0 Time: 1.08299
[11/24/2022-12:08:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.200951
[11/24/2022-12:08:01] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:01] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1000 Time: 0.214738
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:01] [V] [TRT] Tactic: 1002 Time: 0.194624
[11/24/2022-12:08:01] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.214254
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.194624
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(2838528,59136:2,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.710107
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.164969
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.715566
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.164969
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.23867
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.220928
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.258578
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.220928
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.367749
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.19696
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.367776
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.19696
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.420704
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.194126
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.420841
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.194126
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.1957
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.854158
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.213801
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 0 Time: 0.213801
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.31725
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.300393
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.209065
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 0 Time: 0.209065
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.390949
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.173422
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.390592
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.173422
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 3.46774
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.174098
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 3.46621
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.174098
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.32693
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.162793
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 1.30963
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.162793
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(709632,1:8,4032,12) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 2.91481
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.133438
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 2.93762
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.133438
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.23519
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.220937
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 1.2421
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.220937
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.367525
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.194885
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.367269
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.194885
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.420041
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.196037
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.420763
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.196037
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.23242
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.854624
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 1.18923
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.854624
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.313
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.302729
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 1.32061
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.302729
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.389966
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.173879
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.390327
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.173879
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 3.40323
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.174263
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 3.41338
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.174263
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.31344
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.162427
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 1.30718
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.162427
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(354816,1:16,2016,6) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 2.85035
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.133602
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 2.87443
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.133602
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.68816
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.214743
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.749376
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.214743
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.374537
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.200439
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.374039
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.200439
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.423241
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.19376
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.423191
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.19376
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.524672
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.934555
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.484494
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 0 Time: 0.484494
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.419918
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.291077
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.393495
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.291077
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.391566
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.173504
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.391058
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.173504
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.392151
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.172992
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.391191
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.172992
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.327451
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.162327
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.472667
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.162327
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Half(177408,59136:32,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 1.85265
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.133445
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 1.82244
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.133445
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.374683
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.279799
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.198734
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 0 Time: 0.198734
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.426322
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.179077
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.424466
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.179077
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.462935
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.214272
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.463086
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.214272
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.371593
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.461344
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.371561
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 0 Time: 0.371561
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1000 Time: 0.204549
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 1002 Time: 0.196485
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:02] [V] [TRT] Tactic: 0 Time: 0.205422
[11/24/2022-12:08:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.196485
[11/24/2022-12:08:02] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:02] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.45483
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.163122
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.455803
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.163122
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.454761
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.163931
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.455808
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.163931
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 1.05951
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.163643
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 1.01301
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.163643
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(1419264,59136:4,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.595689
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.224613
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.118594
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.118594
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.3896
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.256855
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.391904
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.256855
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.405765
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.176027
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.405902
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.176027
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.458843
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.209079
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.458889
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.209079
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.387314
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.434866
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.38709
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.38709
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.218665
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.16885
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.218642
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.16885
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.455374
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.135568
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.106112
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.106112
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.455145
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.134754
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.455273
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.134754
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 1.31101
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.134571
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 1.30717
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.134571
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(177408,59136:32,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(521 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.158775
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.224823
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0659794
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0659794
[11/24/2022-12:08:03] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.231561
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0810651
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.230089
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0810651
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.228393
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0805417
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.229024
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0805417
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0783634
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.071936
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.112373
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.071936
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.092144
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0893394
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0705844
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0705844
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.234661
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0564175
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0872023
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0564175
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.235255
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0570682
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.233947
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0570682
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.234624
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0594331
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.234368
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0594331
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.10099
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.051677
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0435451
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0435451
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,14784,168,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.199479
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0525851
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.200219
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0525851
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.171401
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0888503
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.171214
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0888503
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0973371
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0791406
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.096912
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0791406
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.171049
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0680015
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.16944
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0680015
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.171666
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.089456
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.168759
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.089456
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0945006
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.053952
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0946217
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.053952
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0947954
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0546118
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.094544
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0546118
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.31627
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.055069
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.320448
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.055069
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.166021
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0561265
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.169755
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0561265
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(1419264,1,16128,96) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.285349
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0559208
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.285938
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0559208
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.173353
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.089056
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.174309
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.089056
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0969577
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0788251
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0970011
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0788251
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.16816
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0679512
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.170011
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0679512
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.172832
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0884114
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.172997
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0884114
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.109424
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0542293
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.109394
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0542293
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.109701
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0540008
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.109275
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0540008
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.317426
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0548434
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.320091
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0548434
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.170638
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0616869
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.171474
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0616869
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(354816,1:4,4032,24) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.286043
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0626225
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.285431
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0626225
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.166016
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0895291
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.16784
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0895291
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.099232
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0791269
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.100167
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0791269
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.110654
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0781897
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.110281
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0781897
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.164146
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0667429
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.163191
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0667429
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.164215
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0888251
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.163566
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0888251
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.109198
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0543817
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.109353
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0543817
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.108747
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0542735
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.109049
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0542735
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.312667
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0544731
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.307913
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0544731
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.161998
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0570697
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.162496
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0570697
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Float(44352,14784:32,168,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.275077
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0566034
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.275003
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0566034
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0833943
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0729074
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.100199
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0729074
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.180887
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0581227
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.179186
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0581227
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.179045
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0582827
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.178784
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0582827
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0857554
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0512457
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0691764
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512457
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.18923
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0442274
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0854126
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0442274
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.189317
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.042712
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.187319
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.042712
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.224937
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0426297
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.225166
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0426297
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.100101
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0529036
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.102565
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0529036
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(1419264,14784,168,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.184238
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0459349
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.185088
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0459349
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0913143
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0668251
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0687939
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0668251
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.134887
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0612952
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.135189
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0612952
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.14352
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0610987
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.143977
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0610987
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0827291
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.259749
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0605531
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0605531
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.144608
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0567055
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0739223
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0567055
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.144827
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0570103
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.14405
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0570103
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.118754
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0566933
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.118606
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0566933
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0553981
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0533973
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0563002
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0533973
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(709632,14784:2,168,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0996046
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0456251
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0989554
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0456251
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.149554
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0620114
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0703528
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0620114
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0975154
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0553813
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0973189
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0553813
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.110183
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0552137
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.110142
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0552137
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.142729
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.197678
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0531733
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0531733
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.142853
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0820709
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.05552
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.05552
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.102693
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.049757
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.103026
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.049757
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.298469
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0498133
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.302057
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0498133
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.142187
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0462377
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.143959
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0462377
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(177408,1:8,2016,12) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.262007
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.037768
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.262098
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.037768
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.150757
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0624168
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.146702
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0624168
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0972754
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.055328
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0972869
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.055328
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.110528
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.055488
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.110309
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.055488
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.14243
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.19781
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.141966
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.141966
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.143374
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0798583
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.14331
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0798583
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.102359
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.049792
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.102855
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.049792
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.299698
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0487223
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.299008
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0487223
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.141945
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0465589
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.143003
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0465589
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:16,1008,6) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.262089
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0374617
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.269472
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0374617
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.104592
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0607497
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.103561
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0607497
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0992343
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0576731
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0985669
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0576731
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.110825
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.054557
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.110624
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.054557
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0886423
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.216645
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0900937
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1000 Time: 0.0886423
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0526994
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0802149
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0525394
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0525394
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.102297
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0497951
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.103001
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0497951
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.102805
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0497082
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.102336
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0497082
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.0630857
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0463097
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0638568
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0463097
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Half(44352,14784:32,168,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.113835
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0384686
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.111799
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0384686
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.101527
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0788526
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.0586697
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 0 Time: 0.0586697
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.111662
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0531596
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.110754
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0531596
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1000 Time: 0.120811
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 1002 Time: 0.0611017
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:03] [V] [TRT] Tactic: 0 Time: 0.121355
[11/24/2022-12:08:03] [V] [TRT] Fastest Tactic: 1002 Time: 0.0611017
[11/24/2022-12:08:03] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:03] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:03] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0956777
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.118887
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0950286
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0950286
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0537509
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0546621
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0547398
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0537509
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.117435
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0468651
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.116994
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0468651
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.118821
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0468617
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.118784
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0468617
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.114327
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0468469
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.114382
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0468469
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784:4,168,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.149618
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0607055
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0342501
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0342501
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.100581
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0728594
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.101232
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0728594
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.10784
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0524297
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.106674
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0524297
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.120283
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0608
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.119931
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0608
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0957051
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.114459
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0954354
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0954354
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0526659
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.048925
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0530453
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.048925
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.118802
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0395246
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0279383
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0279383
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.116286
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0400469
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.117029
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0400469
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.118882
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0386297
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.121248
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0386297
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(44352,14784:32,168,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(524 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0377486
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0593158
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0155054
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0155054
[11/24/2022-12:08:04] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0291694
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0449074
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0298661
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0291694
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0305536
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0449394
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0303771
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0303771
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0976823
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0450549
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0988434
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0450549
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0178326
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0208764
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.026691
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0178326
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0244297
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.023712
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0138868
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0138868
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0306039
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0231582
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0139408
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0139408
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0353161
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0202531
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0359109
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0202531
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0747611
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0208052
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.075088
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208052
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0267878
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.021858
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00872928
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00872928
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0494613
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0183154
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.049792
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0183154
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0303963
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0450457
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0307291
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0303963
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0254156
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0444629
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0248107
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0248107
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.111623
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0444789
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.111563
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0444789
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0300471
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0233352
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0301102
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0233352
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0301102
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240373
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0302062
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240373
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0246469
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0239055
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0247421
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239055
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0306505
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204571
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0307666
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204571
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0878354
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0205767
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0877051
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205767
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0309413
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0215001
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0308361
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0215001
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.062141
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0211461
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0624183
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211461
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.030837
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0452389
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0305582
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0305582
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0244251
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0442377
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0249349
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0244251
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.111993
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.045216
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.111584
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.045216
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0303762
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0231027
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0302382
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0231027
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0306395
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0241745
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0305719
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241745
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0288622
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240869
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0291392
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240869
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0349266
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0206198
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0345984
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0206198
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0880389
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204787
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0880023
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204787
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0309477
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0286638
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0312009
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0286638
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0623238
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.025891
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0623726
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.025891
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0392629
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0453429
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0393429
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0392629
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0249303
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0446891
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0245867
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0245867
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0303616
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.046424
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0306176
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0303616
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0392434
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0238735
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0393954
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0238735
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0395143
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240434
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0401486
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240434
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0290094
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.023614
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0289563
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.023614
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0348809
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204245
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0348718
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204245
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0927794
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204918
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0930057
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204918
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0397543
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.022831
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0394903
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.022831
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0674804
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0224823
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0672808
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0224823
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0174197
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0209404
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0262598
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0174197
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0229322
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.022846
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0228624
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.022846
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0257227
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0226651
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0259299
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0226651
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0977531
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0202377
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.097488
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0202377
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0224242
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0198446
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0138423
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0138423
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0244968
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0180131
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0139408
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0139408
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0286985
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0170022
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0288064
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0170022
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0747131
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0169884
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0750194
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0169884
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.027792
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0212976
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0277341
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212976
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0491779
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0181217
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0493608
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0181217
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0245356
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0227435
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0129082
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0129082
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0247771
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0235024
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0251162
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0235024
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0291273
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0232673
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0288475
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0232673
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0976731
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0205825
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0975817
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205825
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0224536
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0622949
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0134562
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0134562
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0284952
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0239939
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00953265
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00953265
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0328064
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204852
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0329289
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204852
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0395017
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204238
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.039552
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204238
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0173765
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0220186
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0166512
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0166512
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0273006
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0188286
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0271177
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0188286
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0252549
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0227794
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0103745
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0103745
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0251634
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0237068
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0249608
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0237068
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0293129
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0234834
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0293102
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234834
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.10397
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0210508
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.104249
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210508
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0229571
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0602773
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.009398
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.009398
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.026403
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.024269
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00957623
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00957623
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0328503
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0209744
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0329518
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0209744
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0809257
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0206544
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0806629
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0206544
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.031029
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0216686
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0308855
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0216686
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0551985
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.018568
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0551421
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.018568
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0265059
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0227592
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0264343
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0227592
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.025453
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0231478
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0254438
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0231478
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0297765
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0234482
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0295314
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234482
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.106901
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0210129
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.10683
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210129
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0237316
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0597166
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0235102
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0235102
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0265562
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.024131
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0262903
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.024131
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0284808
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0241493
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0284907
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241493
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0827817
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0210789
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0831246
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210789
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0309495
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0217731
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0309723
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0217731
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0573211
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0185411
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0573592
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0185411
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.025952
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0230785
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0262072
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0230785
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0247063
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0238568
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.024941
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0238568
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0293403
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0236918
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0291227
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0236918
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.106178
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0239131
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.10648
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239131
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0238171
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0594164
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0236774
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0236774
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0153376
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0242469
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0155589
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0153376
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0287049
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240907
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0285806
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240907
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0329609
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0207465
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0328411
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207465
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.01966
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0217842
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.01966
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.01966
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0309842
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0184086
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0311817
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0184086
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0272571
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0368651
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0141374
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0141374
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0271482
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0205995
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.027264
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205995
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0315511
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0288128
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0314761
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0288128
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0972709
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.020736
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0975771
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.020736
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0267284
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0390949
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0267048
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0267048
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0160808
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0220852
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0160858
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0160808
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.032608
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0220336
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0321957
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0220336
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0370457
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0187051
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0370011
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0187051
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0406057
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0186749
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0404914
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0186749
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0410446
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0239192
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00847812
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00847812
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0275604
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0369097
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0274705
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0274705
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0274903
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0230687
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0279109
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0230687
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0322331
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0290469
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0318738
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0290469
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.102357
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0235082
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.102457
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0235082
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0268244
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0395074
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0269661
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0268244
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.01648
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0223269
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0164703
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0164703
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.032448
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0222132
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00748823
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00748823
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0370423
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0195274
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0372343
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0195274
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0418743
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0195137
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0417943
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0195137
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 526) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0137425
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0260914
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00898114
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00898114
[11/24/2022-12:08:04] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.029781
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.045144
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0296768
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0296768
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0303726
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0451989
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0301623
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0301623
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0180263
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0208529
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0266796
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0180263
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0244678
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0236983
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0138622
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0138622
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0307374
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0227259
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0139296
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0139296
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0350802
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.020024
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0351269
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.020024
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0748229
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0205505
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0748274
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205505
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0268213
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0219213
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.00858138
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.00858138
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0496183
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0183497
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0497341
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0183497
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0303369
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.045272
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0305198
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0303369
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0253867
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0443989
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0248038
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0248038
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0300882
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0230361
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.030187
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0230361
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0304695
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240617
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0300517
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240617
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0247764
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0239848
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0249036
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239848
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0306267
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204082
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0307904
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204082
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0876297
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0204807
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0875817
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204807
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0308855
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.021566
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0310583
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.021566
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0623253
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0211331
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0623771
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211331
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0305627
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0453554
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0307931
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0305627
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0248594
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0444389
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0248838
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1000 Time: 0.0248594
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0303241
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0231902
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0303205
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0231902
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0306825
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240389
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0304869
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240389
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1000 Time: 0.0288704
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 1002 Time: 0.0240465
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:04] [V] [TRT] Tactic: 0 Time: 0.0290935
[11/24/2022-12:08:04] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240465
[11/24/2022-12:08:04] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:04] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:04] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0345527
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0206217
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0347986
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0206217
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0877189
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0205492
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0882103
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205492
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0312987
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0288037
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0309696
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0288037
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0622598
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.025917
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0625234
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.025917
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0398126
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0448331
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0397954
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0397954
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0251779
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.044152
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0260648
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0251779
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0290423
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0455429
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0305015
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0290423
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0397371
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0238309
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0398263
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0238309
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0400526
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0240579
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0398629
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240579
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.028779
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0239817
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0289134
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239817
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.034731
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0204186
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0346478
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204186
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0929714
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0207171
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0929897
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207171
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0395246
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0231158
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0395806
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0231158
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0673585
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0223412
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0669821
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0223412
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0173608
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0209482
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0265531
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0173608
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0225169
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.022914
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0227762
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0225169
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0256168
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0228225
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0254293
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0228225
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.022479
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0197937
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0138971
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0138971
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0244335
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0178949
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0139512
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0139512
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0287104
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0171413
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0288338
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0171413
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0745189
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.017026
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.074768
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.017026
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0278949
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0215582
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0279497
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0215582
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.049277
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0180914
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0495055
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0180914
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.024464
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0230465
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0129642
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0129642
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0252
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0234469
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0251238
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234469
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0294857
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0234109
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0293595
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234109
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0224248
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0624899
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0135572
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0135572
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0283368
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.024029
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.00955977
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00955977
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0329216
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0205016
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0329993
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205016
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0396023
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0204441
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0397703
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204441
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0171149
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0218717
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0170169
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0170169
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0272229
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0188109
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0275749
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0188109
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0252846
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0228258
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0105078
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0105078
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0250949
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0237734
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0247429
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0237734
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0293824
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0235063
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0293559
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0235063
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0231941
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0603596
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.00948572
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00948572
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0265707
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0242598
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.00930514
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00930514
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0329554
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0210919
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0330021
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210919
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0811794
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0215151
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.080944
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0215151
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0310098
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0216921
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0308891
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0216921
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0554133
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0183537
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0552945
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0183537
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0263284
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0232229
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.026432
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0232229
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0253356
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0232849
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0252404
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0232849
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0296869
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0233391
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0294976
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0233391
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0236937
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0600137
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0237473
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0236937
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0264952
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0242027
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0261196
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0242027
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0284526
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0240297
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0286391
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240297
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0828434
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0208392
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0829211
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208392
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0314825
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0218671
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0313042
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0218671
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0570804
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0185389
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0567497
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0185389
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0261806
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0229407
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0263832
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0229407
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0250872
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0239726
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0252312
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239726
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0296823
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0237832
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0293074
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0237832
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0236911
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0591101
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.023663
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.023663
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0153513
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0241272
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0154162
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0153513
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0285961
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.024141
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0285787
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.024141
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0328649
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0210769
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0328448
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210769
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0196857
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0218122
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0198731
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0196857
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0311223
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.018448
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0308955
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.018448
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0271497
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.037016
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0141802
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0141802
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0272114
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0206498
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0273295
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0206498
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0312329
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.028928
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0315557
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.028928
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0266933
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0389931
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0267177
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0266933
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0160173
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0221309
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0160422
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0160173
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0325632
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.021854
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0322432
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.021854
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0370343
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.018864
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0371394
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.018864
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0403429
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.01852
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0405703
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.01852
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0407634
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0240091
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.00853916
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00853916
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0273371
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0369954
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0274133
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1000 Time: 0.0273371
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0273463
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0232411
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0275299
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0232411
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0322971
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0290112
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0322222
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0290112
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.026941
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.039456
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0269257
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0269257
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0165262
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0222949
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0163515
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0163515
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0323831
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0222158
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.00757847
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00757847
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0370537
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.019588
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0372137
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.019588
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0421703
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0195583
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0423429
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0195583
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.0136948
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0261318
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.00872524
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.00872524
[11/24/2022-12:08:05] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.447689
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.11336
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.444389
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.11336
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.412718
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.113643
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.413563
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.113643
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.114128
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.10424
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.164741
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.10424
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.135179
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.126912
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.102613
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.102613
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.411936
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.088672
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.12797
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.088672
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.423886
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0893669
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.411525
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0893669
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.381797
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0904389
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.382985
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0904389
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.148137
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0784411
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.0619794
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 0 Time: 0.0619794
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.296544
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0764594
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.296251
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0764594
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.263168
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.13
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.264279
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.13
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.140763
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.109607
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.141307
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.109607
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.263753
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.104274
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.258025
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.104274
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.258144
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.128405
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.258619
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.128405
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.138704
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0834903
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.138123
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0834903
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.137877
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0840457
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.13848
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0840457
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.504128
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0835817
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.505157
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0835817
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.255488
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0827589
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.256855
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0827589
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.424974
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0838948
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.425902
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0838948
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.267049
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.129195
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.271072
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.129195
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.141963
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.109637
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.14221
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.109637
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.263899
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.104107
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.261275
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.104107
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.262811
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.128544
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.264087
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.128544
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.160754
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0838194
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.160174
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0838194
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.160078
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.083776
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.160978
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.083776
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.50427
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0840891
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.515547
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0840891
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.255415
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.09848
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.255867
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.09848
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.424311
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0963794
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.425179
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0963794
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.246926
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.128757
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.247808
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.128757
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.146619
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.109003
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.147817
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.109003
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.162834
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.108944
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.162921
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.108944
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.241431
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.103131
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.240229
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.103131
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.241984
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.1248
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.241134
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.1248
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.161198
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0837234
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.16107
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0837234
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.160439
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0834423
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.161074
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0834423
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.493833
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0826811
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.49328
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0826811
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.238921
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0856914
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.238533
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0856914
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.410816
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0861623
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.410967
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0861623
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.120069
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.105026
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.147314
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.105026
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.326528
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0903246
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.334194
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0903246
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.318135
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0904777
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.305481
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0904777
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.126981
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0719771
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.102085
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0719771
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.337856
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0608152
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.123317
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0608152
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.337531
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.061155
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.337687
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.061155
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1000 Time: 0.368887
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 1002 Time: 0.0650591
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:05] [V] [TRT] Tactic: 0 Time: 0.368046
[11/24/2022-12:08:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.0650591
[11/24/2022-12:08:05] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:05] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:05] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.153573
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0843451
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.152635
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0843451
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.281728
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0718354
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.281001
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0718354
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.133815
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.101952
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.100928
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.100928
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.229189
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.093184
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.229728
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.093184
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.254775
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0931931
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.255607
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0931931
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.120763
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.444169
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0886766
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0886766
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.260416
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0906309
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.109456
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0906309
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.260722
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.090416
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.260695
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.090416
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.195173
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0882629
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.194688
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0882629
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0861966
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0860686
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0861029
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0860686
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.153701
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0735771
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.152791
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0735771
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.229614
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0978423
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.101547
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0978423
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.142405
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0851543
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.142361
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0851543
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.161737
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0851269
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.161975
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0851269
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.22629
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.337893
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0855406
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0855406
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.227694
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.116485
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0829943
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0829943
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.150711
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0824663
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.15125
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0824663
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.487136
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0798583
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.487424
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0798583
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.230537
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0761143
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.23349
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0761143
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.407785
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.064096
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.402203
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.064096
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.229422
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0975223
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.229042
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0975223
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.141829
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.086048
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.142907
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.086048
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.162153
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0854674
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.162537
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0854674
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.22725
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.338487
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.228055
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.22725
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.226789
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.118816
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.227698
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.118816
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.151264
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0827383
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.150958
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0827383
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.488695
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0798674
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.494226
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0798674
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.224741
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0758583
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.224658
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0758583
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.401403
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0638613
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.400416
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0638613
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.153125
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0943474
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.153225
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0943474
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.146647
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0910469
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.147717
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0910469
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.163845
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0843566
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.163753
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0843566
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.140135
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.349111
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.140055
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.140055
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0888983
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.114247
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0889989
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.0888983
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.151122
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0825531
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.151845
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0825531
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.151456
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0821669
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.151826
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0821669
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.114121
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0757371
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.114523
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0757371
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.179296
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0632335
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.179598
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0632335
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.149239
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.111963
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0867634
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0867634
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.168014
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0797463
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.168366
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0797463
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.179136
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0992869
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.180544
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0992869
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.146414
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.185362
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.147237
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.146414
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0800137
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0874743
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0820366
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.0800137
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.176795
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0753851
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.177307
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0753851
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.176562
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0765623
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.177033
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0765623
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.193193
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0731566
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.192933
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0731566
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.226171
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0978811
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.07544
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.07544
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.15248
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.102816
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.152229
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.102816
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.160366
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0821189
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.158665
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0821189
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.176855
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0982423
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.177399
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0982423
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.150405
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.180503
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.151246
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.150405
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0877326
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0790743
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0877074
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0790743
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.175538
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0676465
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0464594
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0464594
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.175159
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0678171
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.175282
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0678171
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.203639
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0651871
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.20107
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0651871
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(529 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0615147
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.100695
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0238286
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.0238286
[11/24/2022-12:08:06] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0975406
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0452023
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.101047
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0452023
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.111792
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.04516
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.11123
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.04516
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.111883
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0442994
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.111305
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0442994
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0970103
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0202194
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0974491
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0202194
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0975954
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0205068
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0976549
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205068
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.104304
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0207771
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.104235
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207771
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.106096
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0208686
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.106135
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208686
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.106016
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.024048
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.106891
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.024048
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0979154
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0207484
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0976114
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207484
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(526 -> <out>) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.101774
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0233796
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.102087
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0233796
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.126258
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0948114
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.125278
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0948114
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.205915
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0961783
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.209303
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.0961783
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 4.6839
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.375255
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 4.67604
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.375255
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0203211
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0244023
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.020112
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.020112
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.113895
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.113895
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.139758
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.264137
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.136258
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.136258
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.212677
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.531552
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.210263
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.210263
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 4.61619
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.491909
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 4.60307
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.491909
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0302272
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0372663
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.0302281
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.0302272
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.13387
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.13387
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.133673
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.264443
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.136069
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.133673
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.212942
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.532389
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.211278
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.211278
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 4.58881
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.492494
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 4.60639
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1002 Time: 0.492494
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.0307099
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1002 Time: 0.0363394
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 0 Time: 0.030645
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 0 Time: 0.030645
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:06] [V] [TRT] Tactic: 1000 Time: 0.132187
[11/24/2022-12:08:06] [V] [TRT] Fastest Tactic: 1000 Time: 0.132187
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:06] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:06] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:06] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.143049
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.264485
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.144288
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.143049
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.219319
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.532027
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.226286
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.219319
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.5956
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.491721
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 4.57698
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.491721
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0395771
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0362103
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.0390549
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.0362103
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.150889
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.150889
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.115863
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.416334
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.116155
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.115863
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.199689
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0926377
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.197253
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.0926377
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.52972
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.254405
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 4.51068
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.254405
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0205904
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0301385
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.0206145
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.0205904
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.103177
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.103177
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.116681
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.545989
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.114215
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 0 Time: 0.114215
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.196434
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.531959
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.198354
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.196434
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.48574
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 1.60316
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 4.49411
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 1.60316
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.027603
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0384674
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.028141
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.027603
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.102203
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.102203
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.115163
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.547214
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.119262
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.115163
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.191831
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.536946
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.195621
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.191831
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.50208
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 1.60007
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 4.48011
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 1.60007
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0283215
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0380846
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.0281928
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 0 Time: 0.0281928
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0996663
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.0996663
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.123682
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.549326
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.122704
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 0 Time: 0.122704
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.197303
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.537207
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.199177
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.197303
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.5185
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 1.60021
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 4.50489
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 1.60021
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0283459
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0367531
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.0283665
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.0283459
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.106265
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.106265
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.123906
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.548905
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.123582
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 0 Time: 0.123582
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.198181
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.53771
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.19936
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.198181
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.51616
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 1.60025
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 4.49498
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1002 Time: 1.60025
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.028467
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0652023
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.0282728
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 0 Time: 0.0282728
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.109186
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.109186
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.113685
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.113685
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.196626
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.196626
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.52274
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 4.52274
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0307575
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0366091
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 0 Time: 0.0308178
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.0307575
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.105031
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.105031
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.112725
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.112725
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.194007
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 0.194007
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 4.47584
[11/24/2022-12:08:07] [V] [TRT] Fastest Tactic: 1000 Time: 4.47584
[11/24/2022-12:08:07] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:07] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1000 Time: 0.0308873
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:07] [V] [TRT] Tactic: 1002 Time: 0.0552259
[11/24/2022-12:08:07] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0308782
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0308782
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 535) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.09384
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.09384
[11/24/2022-12:08:08] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0429577
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.861925
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0431051
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0429577
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.051197
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 2.27521
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0511238
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0511238
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0518629
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 2.27485
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.051747
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.051747
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0406229
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.405417
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0401623
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0401623
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0403383
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.541339
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.03996
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.03996
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0525242
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.541193
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0531032
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0525242
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0573425
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.542464
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.057088
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.057088
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0949257
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.54155
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0942491
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0942491
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0394949
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0394949
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0696625
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0696625
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0432846
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.404005
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0436937
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0432846
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0519528
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.534002
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0514712
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0514712
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.051491
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.534249
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0516815
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.051491
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0401394
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.26208
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.040448
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0401394
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0405291
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.644
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.040216
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.040216
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0521691
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.64192
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0528533
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0521691
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0568244
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.64185
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.056672
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.056672
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0948434
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.6424
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0951246
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0948434
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0392823
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0392823
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0687924
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0687924
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.106697
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.404946
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.107623
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.106697
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0927223
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.536731
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.09288
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0927223
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0933189
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.535547
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0935909
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0933189
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.106917
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.26323
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.106514
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.106514
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.106725
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.64731
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.106405
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.106405
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0931223
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.64595
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0932183
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0931223
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0995931
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.64571
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.101177
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0995931
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.125397
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 1.64586
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.143712
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.125397
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.107081
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.107081
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.109072
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.109072
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0206609
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0213838
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0208013
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0206609
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0247985
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0227207
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0247543
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0227207
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0286967
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.021888
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0287058
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.021888
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0202269
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0222393
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0201497
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0201497
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0265821
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0214883
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0267482
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0214883
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0287305
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.021295
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.028619
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.021295
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0329728
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0182709
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0328576
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0182709
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0746354
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0184469
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0746057
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0184469
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0309138
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0206622
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.00986971
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00986971
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0495162
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0192617
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0494949
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0192617
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0734331
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0734331
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0795954
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0795954
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0782057
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0782057
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0719771
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0719771
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0721074
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0721074
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0783954
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0783954
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0851269
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0851269
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.115701
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.115701
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.071536
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.071536
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(535 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0912343
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0912343
[11/24/2022-12:08:08] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,14784,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(2128896,1,24192,144) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1:4,6048,36) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(2128896,14784,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(1064448,14784:2,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,1:8,3024,18) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(133056,1:16,1512,9) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(532224,14784:4,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Int8(73920,14784:32,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:08:08] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0572663
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0349074
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0561097
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0349074
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0596267
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0337445
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0605333
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0337445
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0235474
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0313774
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0380731
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0235474
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0333175
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0328631
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0185171
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0185171
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0625996
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0266011
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0252655
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0252655
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0701775
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0263337
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0699809
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0263337
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0956229
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0251558
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.093408
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0251558
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.038792
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0236878
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0100898
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0100898
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,3696,84,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0718423
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0223158
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0712564
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0223158
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0525486
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0370251
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0521798
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0370251
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0382674
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0319177
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0382549
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0319177
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.051069
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0267474
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0515672
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0267474
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0521783
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.033312
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0522179
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.033312
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0373977
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0240297
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0357531
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240297
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0357326
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0255832
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0354898
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0255832
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.120391
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0228859
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.120066
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0228859
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.05216
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0239086
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0517958
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239086
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,12096,144) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0978971
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0230589
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0978263
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0230589
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.052195
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0375166
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0525775
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0375166
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0382491
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0341989
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0368789
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0341989
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.050755
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0270202
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.050941
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0270202
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.052259
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0321627
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0520183
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0321627
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0426389
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0241425
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0415303
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241425
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0432343
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.023582
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0416834
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.023582
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.122434
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.02307
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.120011
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.02307
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0520716
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0292352
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0518491
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0292352
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,3024,36) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0977691
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0284282
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0977326
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0284282
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0527177
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0395463
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0536442
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0395463
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0398514
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0335707
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0403006
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0335707
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0448
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0326985
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0447577
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0326985
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0519147
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0295726
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0516328
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0295726
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0526872
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0341358
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.051872
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0341358
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0437863
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0239634
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0432274
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239634
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0436309
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0246088
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0414743
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0246088
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.117819
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0236134
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.119881
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0236134
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.052224
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.025827
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0521051
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.025827
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Float(18480,3696:32,84,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0951497
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0271604
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0949737
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0271604
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0282438
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0313573
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0392469
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1000 Time: 0.0282438
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0468194
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0278484
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0469406
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0278484
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.050275
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0253448
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0505219
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0253448
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.031829
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0217032
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0183223
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0183223
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0466994
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0189663
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0243863
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0189663
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0501592
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0189823
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0483352
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0189823
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.092208
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0202977
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0922171
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0202977
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0392514
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0258446
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0392514
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0258446
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(532224,3696,84,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.070915
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0222472
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0708663
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0222472
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0353938
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0319973
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0179834
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 0 Time: 0.0179834
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0415657
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1002 Time: 0.0257097
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 0 Time: 0.0418217
[11/24/2022-12:08:08] [V] [TRT] Fastest Tactic: 1002 Time: 0.0257097
[11/24/2022-12:08:08] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:08] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:08] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:08] [V] [TRT] Tactic: 1000 Time: 0.0455691
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0271604
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0434663
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0271604
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0319086
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0761211
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0176498
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0176498
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0428137
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0252168
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0166039
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0166039
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.042488
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0256076
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0425966
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0256076
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0485501
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0247657
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0486339
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0247657
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0225763
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0261067
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0224901
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0224901
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(266112,3696:2,84,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0390297
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0223171
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0385417
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0223171
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0473806
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0283604
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0180497
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0180497
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0353774
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0237956
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0354789
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0237956
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0417497
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0237447
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0430537
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0237447
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0466206
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0715589
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0159954
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0159954
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.047648
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0329957
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.015733
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.015733
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0397017
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0242629
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0392731
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0242629
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.117056
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0229623
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.116798
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0229623
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0495543
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0235311
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0496152
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0235311
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,1512,18) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0956366
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0198074
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0952663
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0198074
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0472194
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.028736
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0468674
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.028736
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0358171
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0247779
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0352914
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0247779
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0419703
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.02368
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0426457
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.02368
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0469509
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0751268
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0466114
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0466114
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0480777
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.033589
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0479634
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.033589
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0394423
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0241448
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.039352
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241448
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.11691
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0231478
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.116327
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0231478
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0495284
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0234136
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0498453
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234136
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,756,9) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0953714
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0199011
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0956069
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0199011
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0359451
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0296667
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0350711
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0296667
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0352823
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0278956
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.036792
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0278956
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0418331
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.02392
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0420229
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.02392
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0323045
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0702857
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0319515
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0319515
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0190583
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0325239
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0190709
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0190583
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0393509
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.024157
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0395543
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.024157
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0392629
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0241379
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0394731
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241379
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.026659
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0234044
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0266141
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234044
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(18480,3696:32,84,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.04352
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0198234
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0434469
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0198234
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0382366
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0337481
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0192977
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0192977
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0393589
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0234527
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.039488
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234527
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0455794
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0294848
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.045768
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0294848
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0381051
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0569859
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.038
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.038
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0226371
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0261006
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0227429
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0226371
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0455749
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0232509
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0456137
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0232509
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.045536
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0229851
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0454549
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0229851
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0492373
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0225162
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0494431
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0225162
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(133056,3696:4,84,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0620968
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0288951
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0128316
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0128316
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0384823
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0322843
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0384994
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0322843
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0393589
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.02488
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0392686
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.02488
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0469109
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0294921
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0453006
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0294921
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0388149
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0549562
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0387154
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0387154
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0231798
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0241371
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0233855
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0231798
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0455783
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0214426
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.009478
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.009478
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0454629
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0213793
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0456103
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0213793
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0518004
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0201354
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0512884
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0201354
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(18480,3696:32,84,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(541 -> <out>) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0180766
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0288887
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00937629
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00937629
[11/24/2022-12:08:09] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0109613
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0160747
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0106851
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0106851
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.011783
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0162113
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0116364
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0116364
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0286016
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0161869
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0286811
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0161869
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.00913257
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0111986
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0118076
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.00913257
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0115407
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.012821
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00739086
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00739086
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0117046
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116385
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00711663
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00711663
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0115749
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0119718
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0115924
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0115749
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0224379
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113118
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0224118
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113118
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118949
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0111778
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00535179
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00535179
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0202697
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0110829
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0202777
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0110829
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0158822
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0168244
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0158776
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0158776
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0116171
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0158482
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0113846
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0113846
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0349733
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0159355
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0350574
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0159355
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0159487
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114817
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0159929
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114817
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0158043
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.012509
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0159787
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.012509
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0115098
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114651
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0115847
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114651
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.011623
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114736
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.011565
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114736
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0287506
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011436
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0287141
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011436
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0159807
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.016002
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0254796
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114349
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0256739
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114349
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0159121
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0167086
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0159147
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0159121
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0113952
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0158702
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0113973
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0113952
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0347493
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0158847
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0348663
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158847
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0159792
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0118006
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0158368
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118006
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0160249
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0125775
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0160168
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0125775
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0134998
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115611
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0135115
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115611
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0135938
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0117099
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0134562
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117099
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0288055
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115524
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0286007
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115524
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0159837
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0117517
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0158551
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117517
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0251368
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0119005
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0250019
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119005
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0158514
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0166502
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0157806
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0157806
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0114349
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0158309
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0114043
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0114043
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0132833
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0158345
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0132937
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0132833
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0158089
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011724
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0158523
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011724
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0158327
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0124617
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0159177
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0124617
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0134483
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114785
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0135077
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114785
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0134304
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113871
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0134001
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113871
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.028619
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113066
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0286711
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113066
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0158551
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116578
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0159258
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116578
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0250118
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115685
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.025027
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115685
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.00921457
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114873
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0115889
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.00921457
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0113273
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0110396
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0111768
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0110396
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118235
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116114
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0116185
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116114
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0286354
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113132
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0285562
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113132
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.010942
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113614
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00740709
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00740709
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0114796
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0118755
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00717257
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00717257
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0115232
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115626
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0114134
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0114134
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0224091
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115967
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0224118
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115967
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118706
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114789
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0119589
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114789
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0201909
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113449
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0203057
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113449
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0116206
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0119455
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00723931
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00723931
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0117285
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0112707
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0115429
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112707
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.013413
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113561
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0134786
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113561
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0287342
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113625
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0286958
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113625
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0109642
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0240724
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00725691
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00725691
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0119307
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116986
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00565486
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00565486
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0120621
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116216
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.012043
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116216
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0137862
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113164
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0137243
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113164
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.00907714
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0117022
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00894714
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00894714
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0135248
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114272
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.013462
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114272
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118171
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0118882
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00652031
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00652031
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0117922
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114876
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0115625
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114876
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0135348
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115938
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0135439
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115938
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0309266
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114462
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0310007
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114462
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0112682
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0222126
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00537566
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00537566
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0117384
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0124015
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00537058
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00537058
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118583
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114919
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.012005
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114919
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0245097
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115495
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0245371
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115495
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0138539
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011533
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0138548
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011533
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0223634
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0223556
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0117577
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116874
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0114806
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0114806
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.011776
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114423
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0115625
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114423
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0135152
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114398
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0136706
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114398
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0308279
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113948
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0310199
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113948
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0112566
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0222811
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0112883
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112566
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118368
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.012403
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0117211
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0117211
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0120316
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116047
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0119931
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116047
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0246011
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011577
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0245318
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011577
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0138111
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116775
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0138144
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116775
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0224496
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0119185
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0224529
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119185
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0119147
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0118748
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0114729
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0114729
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0116687
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113966
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.011527
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113966
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.013494
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114535
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0136665
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114535
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0307712
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011341
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0308599
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011341
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0112777
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0219056
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0112728
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.0112728
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.00762779
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0125215
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00768313
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.00762779
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0119417
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115042
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0119124
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115042
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0119863
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0119821
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.012013
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119821
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.00951629
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116434
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00957044
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.00951629
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0138602
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011712
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0139104
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011712
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0119128
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0150391
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00752072
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00752072
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118516
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113804
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0120133
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113804
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0138074
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0118171
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0138373
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118171
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0286144
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.011257
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0287735
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.011257
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0118949
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.019792
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0119928
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0118949
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0088839
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0115611
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00885862
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00885862
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0138431
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113143
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0137974
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113143
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0137696
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0113705
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.013802
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113705
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0139167
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0114402
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0139088
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114402
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0195017
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0116498
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.00540275
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00540275
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.0119291
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0150523
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 0 Time: 0.0119836
[11/24/2022-12:08:09] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119291
[11/24/2022-12:08:09] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:09] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1000 Time: 0.011909
[11/24/2022-12:08:09] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:09] [V] [TRT] Tactic: 1002 Time: 0.0111828
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0119943
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111828
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0138261
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0116121
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0137932
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116121
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0300233
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0113396
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0299575
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113396
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0118804
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0197583
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0118432
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0118432
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00893686
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0113762
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00894743
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.00893686
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0138431
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115035
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00527053
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00527053
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0138477
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0114961
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.013893
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114961
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0144014
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0112345
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0141249
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112345
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 543) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00849318
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0116301
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00573769
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00573769
[11/24/2022-12:08:10] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0110203
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0162641
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0107053
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0107053
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0116955
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0161412
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0116118
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0116118
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00920114
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0112791
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0117556
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.00920114
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0115418
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0130061
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00746697
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00746697
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0118302
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118505
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0070794
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0070794
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0117728
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117426
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0116972
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0116972
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0224653
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0113519
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0225567
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113519
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0118312
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115263
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00546167
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00546167
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0202029
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0112907
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.020276
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112907
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0158776
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0168742
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0158847
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0158776
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0116775
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.015901
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0114961
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0114961
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0158025
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0113618
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0158162
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113618
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0158546
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0125989
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0159172
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0125989
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0117964
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0116754
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0113962
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0113962
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0115196
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117282
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0121928
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0115196
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0291858
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.011731
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0292882
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.011731
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0175914
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118062
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0174065
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118062
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.026128
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.012043
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0263215
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.012043
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0166085
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.017568
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0165298
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0165298
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0123238
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0169717
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0121375
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0121375
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0161229
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0121783
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0162072
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121783
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0171825
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0130252
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0170194
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130252
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0140301
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117236
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.013775
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117236
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0140788
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117918
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0138676
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117918
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0288539
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118133
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0289573
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118133
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0175162
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.012099
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0173699
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.012099
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.026099
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0120869
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0261707
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120869
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0162778
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.017311
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0165547
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0162778
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0121467
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0168401
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0121707
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0121467
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0134974
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0169422
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0132181
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0132181
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0161625
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.012488
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0161646
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.012488
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0171952
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0128968
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0172038
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0128968
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0135572
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117946
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0140605
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117946
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.013898
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118305
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0138585
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118305
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0288978
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0288942
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0173531
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0120286
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0172759
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120286
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0260579
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.012107
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0261928
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.012107
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00961128
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119703
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.012581
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.00961128
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0121086
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0113473
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0119817
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113473
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012397
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0120705
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0124187
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120705
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0119783
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118713
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00897229
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00897229
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0122632
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119638
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00744777
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00744777
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0122004
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119215
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0121436
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119215
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0234116
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118523
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0234305
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118523
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0126187
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119173
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.012837
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119173
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0207158
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117507
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0207301
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117507
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0124312
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0126884
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00782797
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00782797
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0123947
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115341
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.012325
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115341
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0141103
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117517
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0142043
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117517
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0118713
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0249539
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00751904
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00751904
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0128488
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117749
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00664374
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00664374
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0128476
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0126968
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0149874
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0116607
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150592
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116607
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0096128
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117271
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.009404
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.009404
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0141369
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117908
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0144146
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117908
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0125825
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.012597
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00687456
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00687456
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012309
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115446
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0122503
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115446
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0141357
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.011846
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0141506
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.011846
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0120202
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0233535
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00658099
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00658099
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0127105
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0130597
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00643319
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00643319
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012856
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117159
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0129055
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117159
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0261105
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0116842
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0260891
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116842
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150327
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119425
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150894
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119425
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0233273
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0121497
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0233659
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121497
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0124389
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0125592
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.012317
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.012317
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0125364
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117081
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0122221
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117081
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.014304
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119535
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0143762
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119535
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012181
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0233933
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0120343
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0120343
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012565
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0130747
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0124141
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0124141
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012744
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119318
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0128743
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119318
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0261539
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0121855
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.026173
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121855
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0151008
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.011815
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0151237
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.011815
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0232738
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0119482
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.023375
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119482
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0123448
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0127981
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0122899
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0122899
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0124971
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115246
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0122716
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115246
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0143052
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118154
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0141856
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118154
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012243
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0230544
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0121105
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0121105
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00900114
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0129204
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00897972
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00897972
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0128396
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118664
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0129002
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118664
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0128103
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117004
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0129288
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117004
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00997029
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.011636
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0100096
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.00997029
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150222
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.011962
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150331
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.011962
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0127573
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0154752
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00892988
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00892988
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0126613
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0113305
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0128903
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113305
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150592
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118407
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150496
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118407
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0126952
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0204833
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0127413
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0126952
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00944143
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117897
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00935486
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00935486
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150007
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0116149
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150839
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116149
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150162
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115189
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150683
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115189
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150875
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0114469
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0151712
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114469
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0206465
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0118653
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00666016
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00666016
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.012709
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0158872
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0128156
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.012709
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0128164
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0111662
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0128514
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111662
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0151237
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.01196
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150688
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.01196
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0127158
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0205466
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0128358
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0127158
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0096064
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0114817
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00948457
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00948457
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150258
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0117978
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00623543
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00623543
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0150843
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115805
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0150894
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115805
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0152238
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0115903
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0152718
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115903
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.00928486
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0121943
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.00663252
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00663252
[11/24/2022-12:08:10] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0852571
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0535451
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0875771
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0535451
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0903154
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0552427
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0897486
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0552427
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0432514
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0440926
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0576305
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1000 Time: 0.0432514
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0505463
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0485516
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0397737
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0397737
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0794377
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.033429
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0416309
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.033429
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0803291
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0332937
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0821006
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0332937
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.117968
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0364857
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.116818
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0364857
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0531825
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0260335
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0172241
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0172241
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.094224
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0274629
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.094704
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0274629
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0873417
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0569585
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0877189
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0569585
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0593783
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0565577
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0617067
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0565577
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0703223
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0368789
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0722514
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0368789
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0714971
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0491992
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0694979
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0491992
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0518842
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0304768
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0539581
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0304768
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0492998
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0336411
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0530667
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0336411
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.150743
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0300846
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.151227
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0300846
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0697082
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0281097
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0700297
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0281097
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.13312
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0284488
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.13373
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0284488
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0918903
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0528259
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0920571
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0528259
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0618149
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0559451
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0628373
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0559451
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.072192
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0380309
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.072272
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0380309
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0746034
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0491977
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0723794
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0491977
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.057568
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0299621
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0547093
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0299621
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0559817
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0277493
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0566491
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0277493
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.152722
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0279794
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.152178
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0279794
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0696244
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0314789
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0688488
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0314789
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.131918
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0317495
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.134297
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0317495
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.07272
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0459874
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0731703
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0459874
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0532251
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0372629
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0536549
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0372629
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0584381
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.039792
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0585448
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.039792
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0667429
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0374583
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0667124
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0374583
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0682255
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0448571
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.069277
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0448571
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.056512
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0281867
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0569021
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0281867
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0576564
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.027725
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0574507
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.027725
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.147127
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0289179
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.148114
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0289179
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0671147
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0281524
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0672168
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0281524
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.12832
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0306551
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.125015
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0306551
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0428526
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.042216
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0514651
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.042216
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0653989
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0312887
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0692434
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0312887
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.06416
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1002 Time: 0.0318784
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 0 Time: 0.0662796
[11/24/2022-12:08:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0318784
[11/24/2022-12:08:10] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:10] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:10] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:10] [V] [TRT] Tactic: 1000 Time: 0.0405989
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0267642
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0232157
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0232157
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0648015
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0258857
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0249646
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0249646
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0627429
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0270438
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0605958
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0270438
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.109362
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0228336
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.109509
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0228336
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0501257
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0288165
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.04992
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0288165
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0922537
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0249234
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0930834
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0249234
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0483764
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0398914
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0312073
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0312073
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0578088
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0324123
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0579474
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0324123
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0604876
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0325358
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0601768
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0325358
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0408663
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0955794
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0215386
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0215386
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.056256
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.028683
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0166293
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0166293
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0562804
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0285813
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0565029
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0285813
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0571916
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0286921
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0574415
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0286921
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0289024
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0291291
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0287552
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0287552
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0495954
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0249463
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0496579
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0249463
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0625204
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.037728
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0255657
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0255657
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0510552
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0307694
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0483855
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0307694
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.055808
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0288494
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0570834
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0288494
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0617783
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0870629
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0169905
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0169905
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0628541
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0422286
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.016414
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.016414
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0515109
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0255124
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0512061
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0255124
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.143973
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0256731
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.145198
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0256731
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0631954
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0253318
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0641143
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0253318
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.125611
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0211631
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.125902
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211631
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0630476
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0373611
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0635322
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0373611
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0483261
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0291282
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0493699
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0291282
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.055264
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0284069
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0572328
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0284069
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0616091
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0865074
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0609798
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0609798
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.062813
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0411703
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0632671
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0411703
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0511177
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0256389
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0513524
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0256389
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.144535
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0254606
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.144224
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0254606
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0650149
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0248899
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0634667
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0248899
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.125918
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0211213
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.125893
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211213
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0460857
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0361989
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0464469
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0361989
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0502537
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0313152
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0499078
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0313152
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0561844
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0287506
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0563703
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0287506
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0412389
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.08912
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0412583
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0412389
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0242469
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0405783
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0249059
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0242469
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0513798
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0256891
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.05136
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0256891
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0511863
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0253882
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0511375
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0253882
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0332937
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0248289
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0330725
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0248289
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.056003
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0212473
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0561783
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212473
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0501836
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0382823
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0266575
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0266575
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0514789
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0292096
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0506819
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0292096
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0599863
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0311918
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0603291
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0311918
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.049731
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0703406
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0491124
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0491124
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0283314
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0301358
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0285463
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0283314
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0596709
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0253257
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0593036
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0253257
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0593905
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0252091
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0595139
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0252091
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0580495
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0249714
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0580145
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0249714
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0800046
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0329106
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0161651
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0161651
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0496747
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0360389
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0503451
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0360389
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.052701
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0253105
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0560731
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0253105
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0600091
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0313307
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0592274
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0313307
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0496107
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0677135
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0496594
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0496107
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0283185
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0258994
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0286702
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0258994
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0591939
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0213649
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0110453
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0110453
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0592747
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0215432
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0594301
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0215432
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0603764
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0214929
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.060736
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0214929
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(546 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0222158
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.032811
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.00968594
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00968594
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0286034
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.016099
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0286171
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.016099
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0348297
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0158432
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0350181
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158432
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0347904
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0158327
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0344247
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158327
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0285824
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.011424
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.028608
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.011424
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0286418
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0114047
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0287232
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114047
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0306889
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0120568
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0308928
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120568
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0306734
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0116469
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0310208
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116469
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0308818
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0114497
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0308105
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114497
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0287753
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.011527
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.028747
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.011527
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(543 -> <out>) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0295397
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0113276
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0295461
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113276
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0338295
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0346651
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0337637
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0337637
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.062816
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0348233
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0627063
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0348233
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.55255
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.130626
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.50398
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.130626
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0096771
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.013024
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.00967345
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.00967345
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0308087
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0308087
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.039944
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0667703
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0396983
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0396983
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0687543
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.133671
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0688396
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0687543
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.52534
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.125481
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.51219
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.125481
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0158776
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0179366
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0156197
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0156197
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0340526
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0340526
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0393314
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0670461
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0397977
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0393314
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0682834
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.134263
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0682316
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0682316
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.51744
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.125566
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.48904
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.125566
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0154921
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0202017
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0155703
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0154921
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.030667
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.030667
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0395246
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0670232
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0392823
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0392823
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0683627
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.134135
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0684358
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0683627
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.50332
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.125134
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.49131
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.125134
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0156901
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0245265
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0155461
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0155461
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0282971
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0282971
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0338551
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.142069
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0336329
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0336329
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0626667
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0335259
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0620922
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0335259
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.50043
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0905211
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.48247
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.0905211
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.00980023
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.023055
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.010048
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.00980023
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0247627
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0247627
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0343771
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.141694
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0340325
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0340325
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0626179
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.13101
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0624152
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0624152
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.48683
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.395168
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.48638
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.395168
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0120008
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0263985
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0122956
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0120008
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.027968
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.027968
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.035864
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.141989
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0357047
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0357047
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0642499
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.131323
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0641432
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0641432
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.49241
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.394427
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.50426
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.394427
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0131009
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0273623
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0128914
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0128914
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0280343
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0280343
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0353774
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.142078
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0353911
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0353774
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0642682
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.131333
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.0639482
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 0 Time: 0.0639482
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 1.50478
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.394126
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 1.49533
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.394126
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0126998
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.0288439
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 0 Time: 0.012965
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0126998
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0273105
[11/24/2022-12:08:11] [V] [TRT] Fastest Tactic: 1000 Time: 0.0273105
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:11] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1000 Time: 0.0355136
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:11] [V] [TRT] Tactic: 1002 Time: 0.141504
[11/24/2022-12:08:11] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0354725
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0354725
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0644602
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.131579
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0642651
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0642651
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 1.4884
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.394971
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 1.49068
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.394971
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0124971
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0289719
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0128278
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0124971
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0274949
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0274949
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0345783
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0345783
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0635581
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0635581
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 1.50971
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 1.50971
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0133232
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0275055
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0132509
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0132509
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.031136
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.031136
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0349285
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0349285
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0636998
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0636998
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 1.47899
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 1.47899
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0135663
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0326418
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0136266
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0135663
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 561) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0270949
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0270949
[11/24/2022-12:08:12] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0110054
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.292288
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0112967
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0110054
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0292059
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.574181
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0286345
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0286345
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0287762
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.574327
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0284937
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0284937
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0110657
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.138359
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.011257
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0110657
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.011965
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.138942
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0120545
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.011965
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.028736
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.139115
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0286912
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0286912
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0286729
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.139024
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0286327
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0286327
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0233195
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.139385
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0231549
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0231549
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0135102
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0135102
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0201954
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0201954
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0114644
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.136999
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0113962
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0113962
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0286994
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.137342
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0286702
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0286702
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0287936
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.137639
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0288677
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0287936
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0111961
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.426958
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0109211
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0109211
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0116571
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.417248
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0116825
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0116571
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0285676
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.417294
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0287488
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0285676
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.028661
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.417065
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0286939
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.028661
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0228447
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.416937
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0231393
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0228447
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0137159
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0137159
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.020312
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.020312
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0403429
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.140793
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0405749
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0403429
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0539307
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.141237
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0534933
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0534933
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0539246
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.141102
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.054045
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0539246
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0401417
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.425097
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0399417
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0399417
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0401646
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.417147
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0401989
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0401646
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0534171
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.417047
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0533912
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0533912
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0532815
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.416631
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0535512
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0532815
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0429223
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.416283
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0428617
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0428617
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0405109
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0405109
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0419451
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0419451
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.00966491
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0132006
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00953996
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00953996
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.01159
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0129067
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0116318
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.01159
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0123985
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0124164
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0123783
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0123783
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.00955886
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0138514
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00964206
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.00955886
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0118759
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0111395
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0118337
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111395
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0122842
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0111863
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0124206
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111863
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0122575
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0113983
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0124164
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113983
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0224503
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0112661
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0225208
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112661
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0137168
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115844
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00689916
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00689916
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0203171
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115798
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0203183
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115798
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0146432
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0146432
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0536229
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0536229
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0531109
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0531109
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0190246
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0190246
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0154875
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0154875
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0533105
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0533105
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0527131
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0527131
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0317925
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0317925
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0155616
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0155616
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(561 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0292443
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0292443
[11/24/2022-12:08:12] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(709632,1,16128,192) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1:4,4032,48) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(709632,3696,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(354816,3696:2,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,2016,24) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,1008,12) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:32,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:08:12] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.02221
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.012669
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0220304
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.012669
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0224927
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0126583
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0224405
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0126583
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0114022
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0134645
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.015939
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0114022
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0139246
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0185486
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00938771
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00938771
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0223047
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0119326
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00950629
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00950629
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.022302
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0117461
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0223399
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117461
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0315776
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116431
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0321143
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116431
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0159599
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116455
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00644353
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00644353
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,924,42,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0284274
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.011622
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0281836
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.011622
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0203549
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0158075
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0205793
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158075
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0146514
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0117619
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0144955
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117619
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.020384
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0151881
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0202937
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0151881
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0219435
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0182291
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0219213
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0182291
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0152174
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116624
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0153682
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116624
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.015371
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115608
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0153911
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115608
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0410846
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115727
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0411531
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115727
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0221812
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116723
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0222263
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116723
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(177408,1,8064,192) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0371463
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116663
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0370583
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116663
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0207145
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0160274
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0207909
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0160274
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0143973
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0118284
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0143218
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118284
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0204225
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0152133
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0204186
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0152133
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0221734
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0181423
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0221845
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0181423
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.01747
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116371
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0170357
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116371
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0173582
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0117229
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0175573
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117229
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.04088
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116251
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0406549
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116251
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0222955
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0129661
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0221675
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0129661
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(44352,1:4,2016,48) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0369429
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0128869
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0370137
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0128869
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0207628
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0158002
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0208594
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158002
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0140717
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116262
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0140085
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116262
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0164444
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0117827
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0164206
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117827
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0203891
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0154167
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0203566
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0154167
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0213349
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0179834
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0211409
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0179834
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0172724
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114486
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0170067
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114486
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0169356
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0112629
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0167873
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112629
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0392274
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0113238
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0391806
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113238
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.021807
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0121143
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0221362
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121143
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Float(5544,924:32,42,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0351717
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.011814
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0352283
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.011814
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0115703
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0135572
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0157198
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0115703
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0202554
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115516
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0202817
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115516
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0202726
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115077
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0203063
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115077
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0137787
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0127928
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00927714
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00927714
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0202474
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0125962
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00946057
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00946057
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0203063
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0126434
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0203429
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0126434
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0308489
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114831
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0310574
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114831
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0160422
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0134242
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160955
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0134242
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(177408,924,42,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0284411
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115907
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0281912
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115907
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0139807
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0169961
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00887234
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00887234
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0181017
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115921
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0182109
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115921
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0181451
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.011674
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0181257
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.011674
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0137297
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0353426
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00905114
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00905114
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0183286
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.011418
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00733646
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00733646
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0180006
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115182
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0179526
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115182
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0183046
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0117124
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0180966
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117124
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0112812
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0130041
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0112907
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112812
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(88704,924:2,42,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0160127
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0117155
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160879
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117155
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0182674
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0161783
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00906657
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00906657
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0152709
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115766
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0150336
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115766
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0174893
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.011539
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0174095
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.011539
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0181817
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0336274
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00754743
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00754743
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0182211
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0175197
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00729691
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00729691
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0160742
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114212
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160579
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114212
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0387451
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0113825
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0385246
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113825
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0201829
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.012915
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0200657
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.012915
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:8,1008,24) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0349659
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0118818
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0351817
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118818
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0181737
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0161458
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0182623
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0161458
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0152859
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116026
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0154949
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116026
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.017661
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0115063
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0173222
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115063
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0181411
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0338615
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0181794
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0181411
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.018168
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0174964
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0183709
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0174964
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0161046
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0118196
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160808
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118196
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0390194
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.011495
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0391063
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.011495
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0200806
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.012781
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0201811
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.012781
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:16,504,12) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0349522
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116828
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0350409
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116828
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0148393
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0158473
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0146048
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0146048
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0148142
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114486
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0149367
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114486
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0170225
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114145
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0170103
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114145
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0137849
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0332498
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0137899
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1000 Time: 0.0137849
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.00944229
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0173349
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00941571
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00941571
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0159487
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0116905
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160178
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116905
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0159665
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114198
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160102
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114198
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0118973
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0126377
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0117873
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.0117873
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Half(5544,924:32,42,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.018276
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0114595
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0182691
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114595
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0159324
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.017277
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.00938857
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 0 Time: 0.00938857
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0160188
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0121939
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0160051
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121939
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0182183
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0127669
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 0 Time: 0.0181857
[11/24/2022-12:08:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.0127669
[11/24/2022-12:08:12] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:12] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1000 Time: 0.0159528
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:12] [V] [TRT] Tactic: 1002 Time: 0.0261394
[11/24/2022-12:08:12] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0159269
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0159269
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0107546
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0132015
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0108751
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0107546
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0182326
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011399
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0182697
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.011399
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0182211
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0114075
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0182474
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114075
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0183217
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0112345
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.018916
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112345
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(44352,924:4,42,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0269973
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012981
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00743497
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00743497
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0175441
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0179429
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0174786
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0174786
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0176767
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119413
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0176924
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119413
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0200497
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.013376
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0196337
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.013376
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0176737
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0257341
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0174954
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0174954
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.011952
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0138784
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0120248
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.011952
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.020096
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117619
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00676862
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00676862
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0200034
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115815
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0198303
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115815
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0206132
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116649
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0206883
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116649
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:32,42,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(567 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.010037
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0128408
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00701649
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00701649
[11/24/2022-12:08:13] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00940886
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0113329
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00932914
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00932914
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00966095
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117939
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00950457
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00950457
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0177991
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116044
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.01779
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116044
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00713992
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115056
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.009172
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00713992
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00896286
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121029
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00669839
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00669839
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00957653
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120084
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00674992
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00674992
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00972251
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117433
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00955337
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00955337
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0150793
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117974
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0150894
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117974
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009266
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115524
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00581486
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00581486
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0143145
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115105
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0142666
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115105
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0119158
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117394
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0117166
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0117166
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00904771
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116709
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00904857
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00904771
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0207732
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011984
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0208744
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.011984
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0118484
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0113611
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119063
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113611
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0119703
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117553
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119154
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117553
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00903028
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118899
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00900057
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00900057
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00907943
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011879
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00907686
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00907686
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0182823
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118017
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0179909
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118017
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120522
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0120072
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0173552
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011866
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0175523
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.011866
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0119272
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118889
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0118727
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0118727
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00903714
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117507
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00899371
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00899371
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0208052
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118801
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0208509
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118801
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0119371
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118776
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0118484
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0118484
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120301
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119345
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119318
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0119318
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00949629
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012035
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.009364
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.009364
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00945457
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118878
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00943143
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00943143
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0178949
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120705
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0178891
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120705
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120693
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118221
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0120796
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118221
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0171535
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120792
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0173069
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120792
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120202
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121048
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0120187
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0120187
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00899628
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012101
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00899772
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00899628
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009482
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119806
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.009338
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.009338
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0118713
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116716
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119798
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116716
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120964
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118484
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119935
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118484
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00940743
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120476
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00940171
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00940171
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00941314
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012013
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00945657
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00941314
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0180063
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120149
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0179149
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120149
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120453
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119005
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0121851
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119005
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0174938
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119299
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0170916
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119299
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00728503
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00916114
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00728503
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00902286
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0114113
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00904428
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00902286
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00913029
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119425
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00919343
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00913029
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0178691
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116951
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0177722
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116951
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00890703
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120533
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0067121
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0067121
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00915171
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120168
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00650556
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00650556
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00915057
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119299
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.009128
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.009128
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0151328
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119425
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0151442
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119425
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00940743
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117412
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00928486
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00928486
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0136918
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118544
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0138352
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118544
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00899314
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119615
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00655958
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00655958
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009208
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118154
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00917257
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00917257
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00953752
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118418
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00942229
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00942229
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0181211
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119665
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0177935
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119665
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00882689
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0180846
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00659927
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00659927
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00926886
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119863
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00593426
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00593426
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009404
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119173
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00929972
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00929972
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00991025
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119909
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0098688
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0098688
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0073664
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121863
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00719497
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00719497
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00987459
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120472
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00958872
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00958872
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00995048
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115344
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00658826
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00658826
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00914943
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119074
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00915543
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00914943
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00954057
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011973
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00939714
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00939714
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0208046
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012056
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0207641
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.012056
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0100087
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.017725
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.006144
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.006144
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0101218
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117563
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00596419
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00596419
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00941286
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121215
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00933314
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00933314
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0175533
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118622
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0176157
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118622
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0112559
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121562
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0114138
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112559
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0156005
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120377
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0155959
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120377
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0100373
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115165
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0102315
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100373
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00919543
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116635
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00903714
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00903714
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00944971
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012104
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00943486
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00943486
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0207471
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120263
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0208725
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120263
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0100596
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0175909
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.010069
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100596
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0100812
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117932
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0103961
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100812
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00922743
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119665
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00933086
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00922743
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.017602
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120518
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0175446
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120518
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0114651
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0122004
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0113343
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0113343
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0156517
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0122274
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0155296
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122274
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00905429
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117342
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00907086
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00905429
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00904
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116533
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00906
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00904
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00945229
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119916
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00938829
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00938829
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0183006
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118351
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0180423
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118351
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00888955
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0172465
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00894543
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00888955
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00709007
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121512
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00707505
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00707505
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00930114
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119669
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00930143
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00930114
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00928257
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120998
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00931057
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00928257
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00833041
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119893
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00839213
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00833041
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0101001
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119345
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0102511
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0101001
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009486
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0123436
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00666348
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00666348
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0095296
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116251
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00922886
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00922886
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00984533
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119585
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00977341
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00977341
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0182434
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117778
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0178869
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117778
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00951886
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0145957
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00932057
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00932057
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00733943
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115239
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0071776
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0071776
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00981029
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119745
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00975817
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00975817
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00995383
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116171
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00990811
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00990811
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0101093
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118136
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.010094
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.010094
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.014464
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119394
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00578158
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00578158
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00942943
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0122461
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00935114
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00935114
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00952171
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117261
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00935886
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00935886
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00978499
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120728
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00973745
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00973745
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0180423
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115713
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.017992
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115713
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00946057
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.013605
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00934657
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00934657
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0072592
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115601
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00716731
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00716731
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00989562
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116515
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00565626
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00565626
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00986667
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011925
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00975726
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00975726
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0112387
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0114011
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0113122
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112387
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 569) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00711358
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120476
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00649642
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00649642
[11/24/2022-12:08:13] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00961737
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116213
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00935028
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00935028
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00955337
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118942
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00966156
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00955337
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00716091
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115091
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00918286
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00716091
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00911914
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120274
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00668551
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00668551
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00964175
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0122282
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00653444
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00653444
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00966491
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.012104
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00956831
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00956831
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0151374
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116979
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0151429
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116979
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00933943
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117067
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00599219
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00599219
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0144475
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0116543
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0144544
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116543
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0118442
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120703
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0116659
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0116659
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00917486
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118024
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00906171
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00906171
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0118702
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0115436
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0118776
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115436
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120541
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0117542
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119486
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117542
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009216
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119432
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00913
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00913
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00916543
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011944
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00909657
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00909657
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0181634
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118041
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0180343
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118041
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.012192
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119394
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0121349
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119394
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0172968
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0118396
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0170723
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118396
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0118502
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.011936
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119573
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.0118502
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00914314
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119813
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00903914
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00903914
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120278
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120034
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0118523
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0118523
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0119661
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119524
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0120072
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119524
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00936
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121733
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00940257
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00936
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00947343
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120396
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00942686
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00942686
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0180286
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0122301
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0179537
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122301
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0121562
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120674
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0121455
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120674
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0174471
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0123726
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0171627
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123726
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.0120232
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0120023
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.0119558
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.0119558
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.00912543
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0119806
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00912686
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 1000 Time: 0.00912543
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1000 Time: 0.009472
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 1002 Time: 0.0121211
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:13] [V] [TRT] Tactic: 0 Time: 0.00940429
[11/24/2022-12:08:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00940429
[11/24/2022-12:08:13] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:13] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:13] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0119054
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0116262
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0119284
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116262
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.012056
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0116853
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0120396
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116853
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00948743
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119806
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.009478
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.009478
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00941029
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118354
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00941257
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00941029
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0179217
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120057
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.01788
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120057
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0120758
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118143
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0120857
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118143
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0173694
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120579
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0172836
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120579
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00714994
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0115559
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00930314
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00714994
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00923029
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.011609
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00904543
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00904543
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00924314
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0124187
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00916143
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00916143
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00880753
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117398
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00664457
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00664457
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00917572
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118685
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00657849
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00657849
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00916114
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117116
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00910057
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00910057
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0151063
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.011732
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0151415
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.011732
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00946857
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117778
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00922514
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00922514
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0137874
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117408
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0138294
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117408
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00912257
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0115545
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00656478
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00656478
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.009188
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0116248
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00915
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00915
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00970027
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0121379
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00948171
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00948171
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00878118
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.017792
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00666805
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00666805
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00939771
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119825
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00588087
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00588087
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00935657
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120015
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00946029
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00935657
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00985569
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117313
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00988495
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00985569
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00738263
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117545
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00730606
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00730606
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00978926
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117676
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00965425
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00965425
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00998065
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0115749
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00651034
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00651034
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00906457
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117387
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00912857
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00906457
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00955855
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.012072
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00942829
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00942829
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00999589
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0176391
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00622
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00622
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0100687
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118084
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00598057
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00598057
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00927
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119227
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00927257
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00927
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0174781
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118618
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0175446
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118618
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0110773
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120922
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0115045
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0110773
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0154368
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0154816
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0100139
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117243
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0102436
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100139
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00908429
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119364
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00906229
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00906229
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00942
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120792
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00931857
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00931857
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00987733
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0173694
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0101041
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00987733
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0100745
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118509
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0101839
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100745
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00920029
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120488
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00927829
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00920029
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.017504
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119642
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0174857
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119642
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0107177
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0121394
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0107517
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0107177
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0154295
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120568
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0155927
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120568
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00919686
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0116438
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00906971
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00906971
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00917714
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0116083
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00908057
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00908057
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00956709
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119135
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00945371
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00945371
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00884061
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0171789
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00889546
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00884061
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00706133
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0115995
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00705241
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00705241
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00936286
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118326
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00927486
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00927486
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.009204
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0122914
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.009288
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.009204
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00845311
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117778
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00851066
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00845311
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0101202
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118189
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0101498
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0101202
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00932371
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.012056
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0066159
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0066159
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00946314
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0115601
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00939457
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00939457
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00986301
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117201
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00980236
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00980236
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.009376
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0146647
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.009242
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.009242
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00724389
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0114085
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00710204
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00710204
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0097981
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117264
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00983375
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0097981
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00979108
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117693
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00981668
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00979108
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0099968
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0115917
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.010209
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0099968
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0143077
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0120072
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00598076
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00598076
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00945857
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0121688
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00936514
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00936514
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00933486
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0116241
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.009376
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.00933486
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00998827
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.012016
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00987276
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00987276
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00948057
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0136657
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00919
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00919
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.007208
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0114673
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00723337
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.007208
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00979718
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0117057
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00566418
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00566418
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.00985783
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0118055
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00980145
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00980145
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0109182
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0113857
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0108513
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0108513
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0070659
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0119688
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00652966
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00652966
[11/24/2022-12:08:14] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0404857
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0211017
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0414743
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211017
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0439509
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.021041
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0441714
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.021041
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0182829
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0233574
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0283611
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0182829
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0254461
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0264084
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0151515
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0151515
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0402423
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.01741
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0156878
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0156878
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0401989
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0173379
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0443566
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0173379
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.058691
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0178589
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0590979
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0178589
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0287323
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0170844
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.00943143
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.00943143
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0508236
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0173476
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0506956
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0173476
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0369863
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0237714
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0372926
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0237714
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0257638
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0176467
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.025939
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0176467
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0369577
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0244503
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0370731
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0244503
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0379223
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0286373
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0374137
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0286373
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0262514
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0157559
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0261036
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0157559
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0262301
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0157531
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0260571
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0157531
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0757851
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0157047
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0775063
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0157047
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0373634
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.017153
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0376903
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.017153
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0683231
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0169011
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0691977
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0169011
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0381211
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0242811
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0373463
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0242811
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0261958
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0176538
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0255177
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0176538
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.037248
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0240754
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0372457
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0240754
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0375771
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0262956
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0376
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0262956
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0296503
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0159025
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0302491
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0159025
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0301257
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.015653
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0302885
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.015653
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.075552
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0156041
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0762971
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0156041
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0373269
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0203646
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0377326
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0203646
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0689204
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.020446
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0687832
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.020446
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0375166
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0239269
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.037872
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239269
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0253143
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0174359
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0258766
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0174359
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0300087
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0174481
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0302391
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0174481
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0369749
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0246438
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.037128
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0246438
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0377577
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0287433
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.038336
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0287433
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0301211
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.015875
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.030144
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.015875
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.030507
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0157006
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0301056
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0157006
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0740663
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0156384
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0741714
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0156384
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0375177
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0181617
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0376069
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0181617
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0664472
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0181994
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0666164
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0181994
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0188503
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.02339
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0271139
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0188503
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0360297
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.017759
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0331511
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.017759
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.035179
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0176284
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0327854
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0176284
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0235546
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0185629
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0150638
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0150638
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0343552
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0178062
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0155168
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0155168
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0344329
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0177194
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0343881
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0177194
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0586164
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0156315
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.05856
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0156315
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.028885
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.022878
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0288475
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.022878
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0509288
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0171129
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0513478
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0171129
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0251246
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0279726
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0139121
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0139121
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0281509
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0178577
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0268495
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0178577
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0302976
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0176721
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0309577
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0176721
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0236173
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.06256
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0143163
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0143163
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0289106
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0175741
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.012032
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.012032
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.028875
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0175157
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0288576
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0175157
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0317696
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0177321
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0315931
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0177321
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0179097
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0224242
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.017924
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0179097
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.028939
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0170971
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0289445
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0170971
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0318418
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0267985
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0139761
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0139761
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0262088
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0159619
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0261242
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0159619
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0304
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0160295
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0301833
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0160295
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0316078
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0588419
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0126766
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0126766
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0317522
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0283893
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0121589
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0121589
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0289024
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0160274
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0289518
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0160274
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0724914
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0158976
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0725943
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158976
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0343159
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0213414
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0341477
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0213414
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0647665
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0151095
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0643992
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0151095
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.03232
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0267436
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0315401
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0267436
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0260747
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0158928
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.025843
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158928
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0305563
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.015999
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0303689
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.015999
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0317248
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0587246
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0314807
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0314807
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0316663
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0284046
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0319031
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0284046
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0289344
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.016256
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0288887
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.016256
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0725829
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.015696
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0726469
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.015696
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0342738
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0211102
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0343058
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211102
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0643276
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0151031
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0647939
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0151031
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0257029
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0262796
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0258545
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0257029
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0255413
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0174349
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0263604
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0174349
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0302519
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0160305
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0303259
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0160305
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0235233
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0586011
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0235833
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0235233
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0155794
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0277669
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0156951
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1000 Time: 0.0155794
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0290057
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0160213
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0289856
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0160213
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.028896
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0159533
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0289691
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.0159533
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0207471
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1002 Time: 0.0207993
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 0 Time: 0.0206694
[11/24/2022-12:08:14] [V] [TRT] Fastest Tactic: 0 Time: 0.0206694
[11/24/2022-12:08:14] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:14] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:14] [V] [TRT] Tactic: 1000 Time: 0.0316453
[11/24/2022-12:08:14] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0152571
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0318171
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0152571
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0279642
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0276937
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0151904
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0151904
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0289426
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0183017
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0288338
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0183017
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0327022
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0203526
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0323758
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0203526
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0285295
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0452069
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0288658
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0285295
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0177595
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0233731
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0177239
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0177239
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0335781
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0169966
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0333641
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0169966
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0336859
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0171266
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.033429
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0171266
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0318802
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0170032
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0319835
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0170032
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0453977
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.020128
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0127916
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0127916
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0278682
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.026749
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0279436
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.026749
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.02912
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0168442
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0289134
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0168442
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0326217
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0207993
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0325349
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207993
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0288101
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0442537
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0287141
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0287141
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0177976
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0228232
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.017759
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.017759
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0333266
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0151067
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00892235
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00892235
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0333367
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0152037
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0329362
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0152037
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0341184
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0152041
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0340343
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0152041
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(572 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0149952
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0200366
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00890837
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00890837
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0178903
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0114215
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0177275
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114215
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0207079
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0121928
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0207478
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121928
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0206602
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118178
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0208784
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118178
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0178714
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115988
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.017872
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115988
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0179137
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117749
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.017727
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117749
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0206896
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118534
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0208967
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118534
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0206021
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118126
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0209123
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118126
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0180989
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119138
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0181846
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119138
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0180526
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0114947
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0179766
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114947
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(569 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0181406
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116758
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0178874
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116758
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(59136,1,2688,64) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,672,16) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(59136,924,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(29568,924:2,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:8,336,8) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:16,168,4) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(14784,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(1848,924:32,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,16128,384) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,4032,96) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(354816,924,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(177408,924:2,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,2016,48) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(22176,1:16,1008,24) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(11088,924:32,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0126103
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0123021
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0127269
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123021
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.012696
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012053
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.012936
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.012053
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0235291
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012384
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0233881
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.012384
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.008976
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115731
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0112222
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.008976
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00998034
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012216
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00724709
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00724709
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0127032
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012405
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00871261
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00871261
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0126815
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0121478
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0128434
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121478
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0194114
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118256
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0194383
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118256
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0116744
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0113909
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00606419
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00606419
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0178926
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117022
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0177554
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117022
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0143488
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0133141
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0144105
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0133141
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00998918
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0122072
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00998522
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00998522
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0287296
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0125333
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0289079
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0125333
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0140326
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0122602
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0140015
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122602
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0149079
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120865
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0150299
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120865
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100495
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012213
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0099965
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0099965
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100684
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117109
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0100812
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100684
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0235722
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116269
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0236225
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116269
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0149623
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119413
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0150016
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119413
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0222642
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117475
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0221479
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117475
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0147136
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0134471
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0149221
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0134471
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100151
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0125596
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0100666
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100151
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0285745
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012411
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0285531
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.012411
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0146235
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120587
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0148037
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120587
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.014939
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0121813
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0150235
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121813
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119604
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120126
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0119977
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119604
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119783
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118875
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0121147
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118875
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0234919
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118783
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.023409
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118783
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0149819
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120442
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0149029
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120442
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0219912
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120069
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0218142
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120069
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0148581
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.013216
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0148859
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.013216
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100142
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012432
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00996145
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00996145
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119379
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0125204
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0119825
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119379
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0146862
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119783
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0149061
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119783
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0147909
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012184
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0149659
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.012184
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119855
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119543
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0120019
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119543
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0120206
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120171
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0119749
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0119749
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0234207
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.01212
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0234501
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.01212
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0149975
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.011821
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0150441
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.011821
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0209293
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0121082
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0209489
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121082
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00901686
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115924
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00981242
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00901686
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119227
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0110991
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118731
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0110991
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.012
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119059
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0120579
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119059
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0234155
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117472
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0234723
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117472
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00988038
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120453
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00708005
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00708005
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118558
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119082
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00889896
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00889896
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118854
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118836
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0120293
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118836
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.019936
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0121036
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0197109
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121036
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118534
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118228
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118622
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118228
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0177925
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012037
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0178138
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.012037
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00996907
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0125646
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00704305
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00704305
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0108999
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116958
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0108607
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0108607
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0121021
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120621
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.012061
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.012061
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0234847
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116909
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0235657
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116909
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00978987
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0229499
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00695075
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00695075
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119451
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115773
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00659075
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00659075
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118537
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116069
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0119417
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116069
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0124168
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119227
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0122503
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119227
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0088121
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117577
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00900057
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0088121
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0120118
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119745
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0121615
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119745
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0125402
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0126213
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00718423
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00718423
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100221
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117275
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.010084
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100221
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119798
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118203
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0120491
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118203
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0263063
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117841
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0263162
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117841
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0125238
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0218305
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00665309
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00665309
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0126926
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.011925
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00665434
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00665434
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.011898
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118505
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118407
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0118407
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0232424
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117676
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0233776
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117676
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0128061
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119486
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0129371
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119486
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0208033
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119192
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0207491
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119192
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0125859
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0125436
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.012355
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.012355
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100977
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118463
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0100187
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0100187
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.011971
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118294
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0120396
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118294
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0262682
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0262926
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117222
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0123303
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0214158
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0122914
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0122914
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0125147
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120206
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0123745
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120206
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118646
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118688
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118551
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0118551
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0233469
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119699
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.023345
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119699
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.012811
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119684
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.012805
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119684
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0207569
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0123402
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0208967
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123402
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00998552
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.01252
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0100322
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00998552
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0100002
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0114982
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0100136
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100002
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119676
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118136
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0120693
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118136
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0249691
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0114708
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0249036
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114708
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00985905
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.021474
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00996724
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00985905
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00805943
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118175
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00800965
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00800965
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0117771
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117584
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118266
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117584
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119154
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118558
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118164
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0118164
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00914029
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120042
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00929114
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00914029
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0127604
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116962
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0125223
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116962
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119255
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0130668
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00727543
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00727543
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0119143
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0113716
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118435
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113716
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.012269
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119005
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0123829
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119005
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0235677
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115246
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0235233
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115246
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118305
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0177976
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0117
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0117
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00877983
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00894657
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00877983
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.012405
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115355
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0122861
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115355
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0123531
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117858
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0123398
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117858
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0127459
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115647
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0125608
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115647
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0177625
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118643
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00638271
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00638271
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118175
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0130739
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0117521
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0117521
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0118091
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115552
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0118632
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115552
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0125215
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0118998
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0123074
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118998
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0236826
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115851
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.023537
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115851
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0116965
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0169021
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0116617
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0116617
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00896029
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.011628
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00902257
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00896029
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0122282
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115179
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00596305
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00596305
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0124042
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0116969
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0122232
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116969
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0127653
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0114648
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0129349
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114648
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 604) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00833727
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119086
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0066132
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.0066132
[11/24/2022-12:08:15] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0126293
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0121364
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0127192
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121364
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0126495
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012176
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0128137
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.012176
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00885324
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115393
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0112253
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1000 Time: 0.00885324
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00990964
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0124842
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00724571
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00724571
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0128316
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0119223
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00876558
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00876558
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0126949
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0120076
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0128267
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120076
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0191234
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0117651
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0192469
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117651
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0116839
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0115302
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00589111
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00589111
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0177798
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0114876
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0177488
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114876
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0143049
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0132601
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0143003
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0132601
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.00999771
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012403
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.00999649
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 0 Time: 0.00999649
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0141336
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.0122762
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 0 Time: 0.0140921
[11/24/2022-12:08:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122762
[11/24/2022-12:08:15] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:15] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1000 Time: 0.0149088
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:15] [V] [TRT] Tactic: 1002 Time: 0.012011
[11/24/2022-12:08:15] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0149321
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.012011
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0100251
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011866
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0100334
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100251
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00994926
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116733
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0100788
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00994926
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0235468
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116297
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0235611
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116297
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0149202
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0120476
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0148251
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120476
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0217966
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118977
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0222733
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118977
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0146912
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.01377
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.014795
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.01377
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0100136
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.012397
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0102299
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100136
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0144347
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0120541
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0146729
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120541
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0148041
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0120011
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0149184
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120011
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0119512
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119402
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0120716
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119402
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0119467
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118558
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0120221
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118558
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0235977
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117465
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0234893
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117465
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0149632
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119981
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0149134
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119981
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0219624
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119166
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0217084
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119166
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0148224
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0134654
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0149093
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0134654
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00997882
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0125958
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0101257
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00997882
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0120095
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0124274
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119234
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0119234
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0148809
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0122366
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0146327
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122366
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0148855
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0120914
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0149819
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120914
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0120533
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119242
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119733
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119242
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0119909
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118115
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0120347
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118115
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0236003
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011788
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0234051
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.011788
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0149358
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116382
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0150176
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116382
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0208594
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117155
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0208882
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117155
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00902629
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0113586
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00982888
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00902629
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0119299
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0111005
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.012043
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111005
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0119893
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117915
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119981
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117915
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00987185
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011718
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00727223
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00727223
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0119158
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116332
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00883388
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00883388
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0118164
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118446
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119322
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0118164
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.019792
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0115791
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0198834
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115791
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0118544
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0115872
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0118449
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115872
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0181234
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116146
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0178674
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116146
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00997089
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0126575
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00711118
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00711118
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0108728
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116888
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.010943
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0108728
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0120008
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117964
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.012085
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117964
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00979566
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0228153
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0069538
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0069538
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0118076
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117352
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00658577
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00658577
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0118688
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118129
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119261
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118129
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.012397
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119436
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0122118
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119436
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00890487
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.012291
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.008942
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00890487
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0120514
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117799
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0120507
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117799
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.012435
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0129147
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0072768
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0072768
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0100075
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119156
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0100971
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100075
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0120495
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011789
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119966
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.011789
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0124343
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0217293
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00669132
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00669132
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0124918
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118189
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00667782
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00667782
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0118108
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117356
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.011912
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117356
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0232568
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0120594
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0233659
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120594
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0129093
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118136
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0129177
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118136
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0207974
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0121189
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0208999
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121189
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0126004
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0124903
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0121623
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0121623
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00996937
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117697
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0101349
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00996937
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.011981
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119524
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119158
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0119158
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0124293
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0214877
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.012248
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.012248
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.012547
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0121787
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.012355
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121787
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0118147
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118688
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0118632
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0118147
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0232411
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011828
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0233091
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.011828
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0127192
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0122674
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0127078
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122674
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0207765
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.012043
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0208764
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.012043
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00997425
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0125684
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00994956
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00994956
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00995505
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0115362
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0100849
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00995505
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0120114
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118513
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0120149
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118513
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00987398
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0209195
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00996968
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00987398
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00790953
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011949
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00803708
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00790953
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.011866
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0121581
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0118136
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0118136
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0117989
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116287
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119086
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116287
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00924286
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118903
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00925686
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00924286
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0124712
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0120255
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0124034
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120255
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0117806
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0131267
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0073024
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0073024
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.01184
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0112665
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0118899
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112665
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0124248
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118513
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0122945
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118513
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0117672
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0176223
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0117647
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0117647
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00881479
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0115541
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00893943
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00881479
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0123345
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117918
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0123189
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117918
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0123177
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116188
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0122495
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116188
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0127463
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0118716
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0124869
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118716
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0177443
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119961
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00636085
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00636085
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0117022
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0130394
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0117116
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0117022
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0117915
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0117356
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0118576
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117356
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0122469
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0119075
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0122259
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119075
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0117342
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0168386
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0115745
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0115745
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00885835
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116832
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00907714
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.00885835
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0123368
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.011635
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.00600057
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00600057
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.012203
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0115844
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0122625
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115844
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0129025
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0115126
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.012808
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115126
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.00816889
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0116888
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0065974
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0065974
[11/24/2022-12:08:16] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0576046
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0352302
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.059677
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0352302
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0604587
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0316727
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0601524
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0316727
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0241745
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.034091
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0399097
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0241745
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0346633
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0371463
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0206178
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0206178
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0580404
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0238171
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0214282
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0214282
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.056736
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0234051
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0565044
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234051
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0849303
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0241044
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0857463
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241044
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0397006
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0225835
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0119196
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0119196
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.073312
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0224052
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0743406
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0224052
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0586865
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0368926
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0561432
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0368926
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.042968
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0324069
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0436343
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0324069
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.051712
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0324983
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.055456
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0324983
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0609524
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0344174
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.058685
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0344174
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0360914
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0208549
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0371337
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208549
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0361863
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0209959
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0369646
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0209959
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.112215
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0211566
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.11173
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211566
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0561493
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0220421
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0560427
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0220421
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0994994
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0212421
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0998126
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212421
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.059235
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.03924
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0620922
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.03924
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0395131
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0335643
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0390263
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0335643
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0567192
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0348599
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0529158
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0348599
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.056928
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0374069
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0554667
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0374069
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0429989
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0212728
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0427897
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212728
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0424674
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0210573
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0445463
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210573
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.111696
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0214204
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.111627
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0214204
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0562362
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0260952
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0590126
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0260952
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.100009
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.026179
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0998857
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.026179
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0593341
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0383966
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0554133
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0383966
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0437097
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0386926
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0420789
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0386926
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0449817
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0375646
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0476922
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0375646
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0525227
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0323182
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.052003
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0323182
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0538088
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0366823
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0537387
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0366823
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0427051
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0212193
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0425611
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212193
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0427337
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.021137
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.042944
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.021137
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.107502
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0210246
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.107634
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210246
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.053501
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0235109
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0538789
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0235109
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0966651
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0233842
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0962217
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0233842
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0250568
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0322907
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0380789
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1000 Time: 0.0250568
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0461143
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0241676
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0464183
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241676
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0473829
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0242133
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0447703
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0242133
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.032981
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0242796
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0196909
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0196909
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0457611
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0221316
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0219605
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0219605
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0454286
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.021937
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0467154
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.021937
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0846949
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0203503
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0844663
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0203503
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0399966
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0259581
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0397051
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0259581
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0729829
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0224268
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0726309
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0224268
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0386846
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0376583
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0220813
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0220813
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0453246
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.024304
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0412
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.024304
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0427577
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.024736
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0448366
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.024736
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0327305
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0913577
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0183646
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0183646
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0406709
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0240091
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0149248
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0149248
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0419177
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0241029
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.040664
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241029
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0445246
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0239657
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0442949
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0239657
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0236134
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0258133
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0235866
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0235866
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0396137
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0217672
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.039864
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0217672
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0447531
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0357543
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0193383
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0193383
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0372651
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0221081
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.036408
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0221081
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0425063
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0221943
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.04244
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0221943
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0430286
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0849943
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0156069
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0156069
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.0441223
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0366914
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0155419
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0155419
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1000 Time: 0.040248
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 1002 Time: 0.0208594
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:16] [V] [TRT] Tactic: 0 Time: 0.0407474
[11/24/2022-12:08:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208594
[11/24/2022-12:08:16] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:16] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:16] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.105472
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0211174
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.105845
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211174
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0482987
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0243832
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0476998
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0243832
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0933509
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0191097
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0939429
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0191097
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0448354
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0362331
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0431371
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0362331
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0363029
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.022065
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0363371
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.022065
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0436491
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0218227
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0427269
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0218227
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0428217
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0816046
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0428937
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0428217
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0446731
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0351214
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0451611
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0351214
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0400309
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0213153
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0410331
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0213153
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.105506
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0212317
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.105109
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212317
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0479162
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0244206
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0478354
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0244206
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.093568
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0190983
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0937097
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0190983
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0358823
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0346651
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0357863
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0346651
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.036104
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0235762
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0379349
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0235762
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.044824
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0220101
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.042592
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0220101
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0330944
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0829623
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0331191
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0330944
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0208601
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0340754
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0201834
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0201834
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0405703
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0213061
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0410331
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0213061
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0409543
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.020862
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0405989
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.020862
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0269135
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0234201
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0272663
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234201
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.045064
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0191406
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0449257
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0191406
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0390251
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0382046
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0201749
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0201749
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0403006
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0224072
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0401017
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0224072
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.046768
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0262507
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.046624
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0262507
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0397749
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0633524
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0398046
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0397749
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0235324
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0283269
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0238895
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0235324
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0468789
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0217476
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.046608
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0217476
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0469806
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0218945
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0467143
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0218945
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.045016
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0212297
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0451931
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0212297
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0641463
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0268305
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0193211
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0193211
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0394663
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0359566
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.039264
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0359566
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0403383
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0220415
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0401429
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0220415
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0463669
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0260297
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0466549
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0260297
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.03992
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0612053
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0398423
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0398423
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0240274
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0269912
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0240343
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0240274
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.047048
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0194949
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.010002
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.010002
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0467874
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.019584
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0466743
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.019584
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0477394
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0195114
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0477851
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0195114
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(607 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0180994
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0262598
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.00982217
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00982217
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0233874
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0122663
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0234181
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122663
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0287095
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0125059
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0288375
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0125059
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0286299
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0125429
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0284297
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0125429
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.023441
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0119989
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0234423
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119989
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0233802
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0121707
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0233992
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121707
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0261181
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0122175
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0262705
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122175
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0262575
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.01224
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0262949
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.01224
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0249547
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0120808
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0252084
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120808
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0234456
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0116501
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0234469
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116501
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(604 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0235363
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0119402
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0236317
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119402
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.027501
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0292242
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0273455
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0273455
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0488442
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0312155
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0483886
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0312155
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.63166
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.102192
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.62023
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.102192
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.00959421
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.238939
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.009328
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.009328
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0193474
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0193474
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0328101
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0365771
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0321783
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0321783
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0537722
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0369771
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0536274
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0369771
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.63836
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0990811
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.62062
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0990811
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0146661
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0159604
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0144507
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0144507
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0265851
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0265851
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0318656
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0365543
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0321518
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0318656
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.052963
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0367509
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.053379
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0367509
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.6275
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0991223
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.61912
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0991223
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0146505
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0195794
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0142678
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0142678
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0249775
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0249775
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.031787
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0365154
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0324699
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.031787
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0532129
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.036728
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0531246
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.036728
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.63729
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0984228
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.63766
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0984228
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0144795
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0248152
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0140085
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0140085
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0263558
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0263558
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0273653
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.108928
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0270263
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0270263
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0484937
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0304274
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0484389
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0304274
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.62734
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0805966
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.61981
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0805966
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.00957379
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.179721
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.00992122
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.00957379
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0177707
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0177707
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.027421
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.109554
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0275147
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.027421
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0490697
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0526034
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0485714
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0485714
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.63662
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.105767
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.6345
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.105767
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0111979
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0304512
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0116276
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0111979
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0178596
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0178596
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0308041
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.10909
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0306514
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0306514
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0517166
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0498773
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0518674
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0498773
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.62311
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0995017
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.63964
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0995017
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0127265
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0297445
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0124118
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0124118
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0248594
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0248594
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0307291
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.109157
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0307246
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0307246
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0519848
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0498149
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0516297
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0498149
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.62554
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0994994
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.6327
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0994994
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0128122
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0285684
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0124339
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0124339
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0235611
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0235611
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0286702
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.109431
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0285349
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0285349
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0502248
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0501364
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0503954
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0501364
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.62839
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0994194
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 1.63815
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0994194
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.011367
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.029899
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0117187
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.011367
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0243421
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0243421
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0282613
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0282613
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0493775
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0493775
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.11324
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 1.11324
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0114623
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.026112
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0113097
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0113097
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0174994
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0174994
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0271779
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0271779
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0492008
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0492008
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 1.12202
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 1.12202
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0112067
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.0231112
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0114328
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112067
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 622) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0179057
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0179057
[11/24/2022-12:08:17] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.00948543
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.228261
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.00942372
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00942372
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0157198
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.292037
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0156901
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0156901
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0155662
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.292215
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0157179
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.0155662
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.00936143
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.105239
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.00943229
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 1000 Time: 0.00936143
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.010478
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.105673
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0103722
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0103722
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0157742
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.106007
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 0 Time: 0.0156242
[11/24/2022-12:08:17] [V] [TRT] Fastest Tactic: 0 Time: 0.0156242
[11/24/2022-12:08:17] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:17] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1000 Time: 0.0157065
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:17] [V] [TRT] Tactic: 1002 Time: 0.105842
[11/24/2022-12:08:17] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015616
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.015616
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0183554
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.105794
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0182691
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0182691
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0113881
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0113881
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0168792
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0168792
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00954636
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.103911
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00946543
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00946543
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0158208
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.103893
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0157262
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0157262
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0154633
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.104811
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0166222
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0154633
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00974385
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.322002
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00974994
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00974385
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0105006
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.313861
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0102808
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0102808
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.015685
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.31376
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015824
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.015685
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0157033
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.313317
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0157138
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0157033
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0201726
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.31371
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.020136
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.020136
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.012293
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.012293
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0177844
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0177844
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0461817
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.109474
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0399749
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0399749
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0439703
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.109698
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0437806
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0437806
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0442274
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.10971
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0441486
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0441486
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0461646
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.324032
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.045696
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.045696
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0461177
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.318811
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.039296
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.039296
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0438457
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.317883
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.043704
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.043704
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0436869
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.318007
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0436034
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0436034
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.045992
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.318071
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0358297
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0358297
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.028323
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.028323
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0340773
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0340773
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00875133
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.237321
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00871476
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00871476
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00981912
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0123596
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00986088
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00981912
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0112549
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0122293
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0111979
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0111979
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00896286
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.18027
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00873842
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00873842
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00981912
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0114363
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00976457
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00976457
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0113477
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0112095
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0113073
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112095
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0112756
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0113484
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0113227
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112756
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0181977
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0112879
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0183554
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112879
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0115745
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117567
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00574409
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00574409
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0173592
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116269
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0170636
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116269
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0120918
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0120918
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0371371
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0371371
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0372434
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0372434
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0106446
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0106446
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0116343
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0116343
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0371211
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0371211
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0371131
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0371131
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0202863
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0202863
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0119707
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119707
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(622 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0183177
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0183177
[11/24/2022-12:08:18] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(532224,1,24192,576) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1:4,6048,144) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(532224,924,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(266112,924:2,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,1:8,3024,72) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(33264,1:16,1512,36) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(16632,924:32,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:08:18] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0175167
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0135958
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0179914
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0135958
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0179486
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0135472
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0179714
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0135472
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0099011
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.156338
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0146688
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0099011
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127261
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0151858
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00920457
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00920457
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0180543
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119516
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0098752
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0098752
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0180366
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119059
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0178629
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119059
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0263093
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117732
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.026224
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117732
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0148091
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118087
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00679668
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00679668
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,231,21,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0234364
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0115548
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0236108
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115548
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0205982
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0150441
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0206198
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0150441
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127627
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0124564
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0127836
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0124564
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0206302
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0136902
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0206113
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0136902
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0207967
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0147259
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0208307
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0147259
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127657
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118108
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0129128
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118108
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.012768
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.011968
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0128819
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.011968
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0367954
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116287
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0368423
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116287
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0208503
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119897
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0208764
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119897
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(133056,1,12096,576) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0316891
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119532
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0316453
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119532
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0207419
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.015227
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0206296
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.015227
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127851
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0122507
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0127364
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122507
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0205917
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0136499
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.020625
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0136499
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0208823
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0149152
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0208059
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0149152
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0149202
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.012211
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0151753
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012211
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150793
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118203
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0149614
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118203
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0344869
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119314
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0344631
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119314
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0209835
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0128301
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0208346
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0128301
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(33264,1:4,3024,144) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0315273
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0128312
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0315383
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0128312
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0180366
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.015296
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0179549
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.015296
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.012621
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0123707
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0127451
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123707
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150798
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0123703
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150373
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123703
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0180434
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0140181
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0179303
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0140181
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0180926
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0149125
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0183206
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0149125
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0149806
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116367
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015141
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116367
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150368
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118927
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150935
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118927
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0318583
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0115636
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0320082
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115636
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0183783
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0123585
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0182486
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123585
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(4158,231:32,21,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0293029
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0123554
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.02912
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123554
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00979535
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.152457
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0127196
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00979535
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0151374
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0113487
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015109
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113487
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150825
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116132
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0152393
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116132
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0123291
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0121223
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00900943
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00900943
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0151209
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0121086
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00986453
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00986453
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0151497
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118646
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0152
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118646
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0262804
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0120027
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0262011
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120027
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.014987
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.013078
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0148151
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.013078
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(133056,231,21,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0235435
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116593
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0234939
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116593
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127608
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0149362
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00878091
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00878091
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0128373
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116557
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.012917
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116557
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150619
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0115309
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0151451
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115309
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0124526
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0262933
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00883335
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00883335
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0149733
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117971
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0076249
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0076249
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0149317
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117015
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0148823
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117015
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0152553
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0115938
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0153728
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115938
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0100151
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0132123
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0100166
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100151
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(66528,231:2,21,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.015056
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117595
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0151589
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117595
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0168295
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0144649
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00954057
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00954057
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127703
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116793
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0128438
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116793
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.015083
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118949
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150747
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118949
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0157184
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0259421
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00879193
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00879193
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0175517
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0151552
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0085354
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0085354
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0149257
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0121261
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150967
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121261
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0318016
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119512
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0317166
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119512
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0177981
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0129886
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.017695
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0129886
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(16632,1:8,1512,72) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0311086
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0120918
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0304585
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120918
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0166822
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0145161
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0169382
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0145161
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127269
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116905
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0129242
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116905
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150862
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0121928
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150939
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121928
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0158437
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0258438
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015819
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.015819
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0175548
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0150583
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0175863
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0150583
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.014933
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0121688
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0149513
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121688
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0315721
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119562
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0316206
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119562
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0177458
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0130435
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0177189
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130435
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(8316,1:16,756,36) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0312329
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119547
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0306185
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119547
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127802
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.014208
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0127954
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0127802
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0128857
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116709
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.012851
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116709
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0150592
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118351
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150587
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118351
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0125547
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0259017
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.01232
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.01232
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00926114
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0150066
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00938629
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00926114
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0148942
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116948
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0150999
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116948
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.014965
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118917
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015003
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118917
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0117394
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0128731
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.011846
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0117394
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Half(4158,231:32,21,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0157408
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119699
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0157925
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119699
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0148082
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0150775
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00904686
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00904686
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0149079
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117865
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0149243
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117865
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0154011
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0130922
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0153851
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130922
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0148699
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0230132
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0149152
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0148699
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00981943
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0134637
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00973836
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00973836
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0153673
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0115154
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.015365
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115154
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0153335
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116378
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0153504
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116378
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0155625
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118038
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0157047
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118038
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(33264,231:4,21,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0228598
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0122823
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00761528
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00761528
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0147625
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0150615
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0148434
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0147625
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0148777
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118249
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0149513
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118249
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0153157
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.012989
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0153637
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012989
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0148581
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0215053
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0148704
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0148581
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00987916
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0130207
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00981547
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00981547
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0153417
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.011788
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00666203
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00666203
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0153019
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117345
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0152274
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117345
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0175482
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116515
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0172272
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116515
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Int8(4158,231:32,21,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(628 -> <out>) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00978377
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0122587
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00685431
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00685431
[11/24/2022-12:08:18] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00903086
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0115815
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00906229
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00903086
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.009122
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117264
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00905943
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00905943
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0127646
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.011769
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0128309
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.011769
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00648467
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0479756
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00718217
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00648467
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00710727
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119394
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00593664
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00593664
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00913086
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0122446
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00650182
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00650182
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.009122
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0121867
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00905314
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00905314
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0120514
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117929
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0120027
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117929
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00747566
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0120213
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0057589
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.0057589
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0111895
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118551
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.011251
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.0111895
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00964297
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0116343
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.009484
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.009484
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00706024
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0118182
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00709595
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00706024
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.0151968
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119901
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.0152183
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119901
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00952838
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0114272
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.009376
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 0 Time: 0.009376
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.00964267
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0119143
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 0 Time: 0.00969204
[11/24/2022-12:08:18] [V] [TRT] Fastest Tactic: 1000 Time: 0.00964267
[11/24/2022-12:08:18] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:18] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1000 Time: 0.007224
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:18] [V] [TRT] Tactic: 1002 Time: 0.0117672
[11/24/2022-12:08:18] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00721783
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00721783
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00711793
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118463
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00711227
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00711227
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0148951
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121082
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0149609
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121082
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00966613
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118639
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00966034
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00966034
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0128411
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118555
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0127333
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118555
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00961615
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121935
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0095424
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0095424
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00705959
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117046
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00711488
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00705959
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0152009
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119112
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0151712
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119112
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00952442
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121547
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00963962
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00952442
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00974171
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119436
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00946686
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00946686
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00762274
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121478
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00765955
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00762274
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0076071
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120945
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00760373
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00760373
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0146382
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119893
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0146053
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119893
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0098051
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121208
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00964815
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00964815
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0127497
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120556
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.012744
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120556
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00947971
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119844
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00936857
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00936857
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00710661
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118829
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00717051
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00710661
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0075443
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120278
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00744069
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00744069
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00944714
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116339
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00954789
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00944714
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00965547
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117233
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00956678
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00956678
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00756379
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011933
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00757726
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00756379
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00764006
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119074
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00765161
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00764006
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.013014
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011955
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0133174
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.011955
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00966065
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119764
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00947943
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00947943
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0128263
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119836
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0124674
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119836
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00664582
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0467863
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00701279
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00664582
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00891267
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0114212
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00882797
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00882797
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00902714
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117524
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00899943
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00899943
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0128427
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011833
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0127646
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.011833
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00696207
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118583
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00633998
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00633998
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00892971
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119204
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00661174
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00661174
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00887234
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122248
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00893042
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00887234
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0119078
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118428
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0119356
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118428
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00749737
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118632
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00763068
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00749737
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0118847
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118477
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0119166
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118477
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0071212
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116466
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00601543
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00601543
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00740731
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117809
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0073328
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0073328
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00828292
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121451
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00802463
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00802463
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0128743
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119796
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0129371
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119796
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00694182
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0128381
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00595695
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00595695
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00749691
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120621
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0057781
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0057781
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00749714
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0124762
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0074224
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0074224
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00876477
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118407
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00887287
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00876477
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00697121
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119198
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00686912
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00686912
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00890622
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119585
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00896743
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00890622
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00937029
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118273
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00626643
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00626643
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00724732
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117887
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00725326
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00724732
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00760974
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120301
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00755826
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00755826
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0152078
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121368
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0151598
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121368
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00936457
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0127669
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00599257
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00599257
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00935029
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118136
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0059275
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0059275
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00723726
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119033
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00740731
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00723726
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0129883
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120499
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0128385
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120499
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00976244
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119867
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00962804
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00962804
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0128971
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120571
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0131782
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120571
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00930629
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116491
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00940286
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00930629
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00711554
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012021
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00710814
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00710814
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0077671
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121901
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.007648
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.007648
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0151022
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119844
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0150651
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119844
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00931171
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0124693
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00915429
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00915429
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00931943
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121467
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00932829
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00931943
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00760445
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120164
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00774208
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00760445
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0127509
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0123672
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.012733
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123672
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00967619
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012267
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00957074
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00957074
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0126869
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121078
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0127764
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121078
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00753131
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0115935
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00744137
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00744137
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0073616
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119181
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00734971
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00734971
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00786021
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121204
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00772138
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00772138
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0147227
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121448
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0144512
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121448
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00744891
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0127467
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00736046
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00736046
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00691374
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118748
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00691744
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00691374
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00751314
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119829
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00744389
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00744389
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0074176
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122244
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00734743
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00734743
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00699951
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121078
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00714688
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00699951
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00922343
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121341
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00920486
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00920486
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00756595
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0115509
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00629605
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00629605
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00755633
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116097
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0077221
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00755633
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0087075
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120084
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0088277
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.0087075
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0132746
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120633
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0131537
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120633
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0075265
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0125288
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00760734
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.0075265
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00681927
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116037
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00690786
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00681927
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00890192
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117363
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00884356
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00884356
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00887745
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0114145
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00884948
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00884948
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00910229
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0113255
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00914343
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00910229
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.012083
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119661
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00572255
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00572255
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00765474
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117918
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00759771
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00759771
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00758857
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118034
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00747589
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00747589
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0088796
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120457
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00871099
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00871099
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0139944
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117735
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0137026
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117735
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00762803
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122156
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0076942
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00762803
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00703412
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119128
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00700234
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00700234
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00894575
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012123
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0053848
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0053848
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00882662
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012053
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00872901
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00872901
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00936314
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116533
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00926028
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00926028
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 630) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00702193
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121585
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00651096
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00651096
[11/24/2022-12:08:19] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00906171
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0115879
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00909971
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00906171
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.009268
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120339
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00910286
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00910286
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00662151
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0481417
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00727703
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00662151
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00718217
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120164
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00610019
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00610019
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00909028
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120697
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00662068
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00662068
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00910886
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012397
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00920457
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00910886
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0120126
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120309
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0120659
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.0120126
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00738903
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011783
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00582053
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00582053
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0113245
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116557
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0112781
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0112781
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00956769
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119958
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.009506
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.009506
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00723703
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121295
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00712642
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00712642
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00957349
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0115527
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.009456
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.009456
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00962956
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119204
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0095677
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0095677
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00733006
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012235
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00741989
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00733006
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00737577
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119962
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00734012
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00734012
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0147218
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121562
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0148265
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121562
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00963718
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012059
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00976305
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00963718
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0127497
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122625
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0128156
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122625
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00951543
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00948
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00948
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00723269
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120998
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00733189
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00723269
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00964389
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012136
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00953691
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00953691
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0095936
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120728
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00959543
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.0095936
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0077529
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122526
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00769949
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00769949
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00778129
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0123234
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0078785
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00778129
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0143447
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0123238
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0147849
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123238
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00974141
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118952
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00972343
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00972343
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0128621
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119589
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0127722
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119589
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00959421
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0118347
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.009398
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.009398
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00733349
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120152
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00723749
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00723749
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0077197
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122968
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00756644
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00756644
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0095
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117127
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00955154
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.0095
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00973532
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119825
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00971459
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00971459
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00771392
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0123771
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00789125
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00771392
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00793937
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012088
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00797206
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00793937
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0131736
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119684
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0130809
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119684
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00964389
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0122983
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00954667
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00954667
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0125554
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0124076
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0125977
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0124076
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00713709
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0471406
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0072064
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00713709
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00922686
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011597
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00911172
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00911172
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00917257
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0120895
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00908771
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00908771
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00714926
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011987
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00634693
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00634693
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00901829
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0121604
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00667844
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00667844
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00900029
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012237
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00908571
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.00900029
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.0119387
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.012256
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0120053
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119387
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00774905
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0117953
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00756186
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00756186
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.01192
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.011936
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.0120354
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 1000 Time: 0.01192
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00722537
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0116677
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00621067
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00621067
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00758593
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0119566
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00735292
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00735292
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00853593
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0123836
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00827505
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00827505
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1000 Time: 0.00689567
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 1002 Time: 0.0128941
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:19] [V] [TRT] Tactic: 0 Time: 0.00614762
[11/24/2022-12:08:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00614762
[11/24/2022-12:08:19] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:19] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:19] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00778418
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0121573
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00601581
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00601581
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00768722
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0119676
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00773269
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00768722
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00882232
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.01208
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00886669
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00882232
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00693834
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0121299
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00707004
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00693834
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00901486
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0118196
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.008982
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.008982
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00958659
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0117985
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0063845
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0063845
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00732434
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120034
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00727383
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00727383
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00779573
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0123371
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00774376
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00774376
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00938257
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0126236
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00583259
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00583259
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00932314
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0117985
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00583607
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00583607
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0073264
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0118611
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0072752
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0072752
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0128674
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0122476
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.012888
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122476
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00973257
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0122446
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00951457
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00951457
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0131133
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.012168
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0128411
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.012168
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00945429
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0117113
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00949314
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00945429
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0073344
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120457
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00721829
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00721829
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00783976
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120217
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00758809
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00758809
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00932429
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0125341
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00933514
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00932429
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00940743
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0118797
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00925571
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00925571
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00762659
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120019
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00746286
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00746286
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0128305
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120286
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.012784
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120286
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00956526
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0121825
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.009452
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.009452
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0128434
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0118878
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0133278
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118878
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00743634
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0115777
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00742629
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00742629
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00729508
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0119097
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00724023
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00724023
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00765907
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0119699
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00759675
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00759675
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00738194
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0127398
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0073296
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0073296
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00685497
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116821
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0066774
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0066774
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00742331
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120575
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00739611
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00739611
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00749966
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0119806
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00733486
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00733486
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00697056
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120918
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00708789
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00697056
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00917914
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0118351
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00905057
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00905057
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00763164
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0114862
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00631752
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00631752
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00769468
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116723
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0076237
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0076237
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00878844
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0121592
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00891832
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00878844
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00759507
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0127531
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00749486
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00749486
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00687673
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116621
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00678379
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00678379
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00901914
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116547
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.008736
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.008736
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0089081
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.011782
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00883146
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00883146
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.009184
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116585
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00911086
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00911086
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0119752
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0121558
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00578688
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00578688
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00770069
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116322
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00762177
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00762177
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00756235
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116652
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00750491
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00750491
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00884356
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0120335
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00882931
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00882931
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00753973
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0121779
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0078465
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.00753973
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0069255
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116578
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00699254
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0069255
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00886803
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0119209
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00550347
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00550347
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00891025
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0118618
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00871852
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00871852
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.009276
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0116821
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00923543
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00923543
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.00699342
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0117911
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00654712
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00654712
[11/24/2022-12:08:20] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0259596
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0158964
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0254187
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0158964
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0258347
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0157769
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0255124
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0157769
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0127242
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.255625
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0201949
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0127242
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0179211
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0209724
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0117774
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0117774
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0257737
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0138988
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0123474
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0123474
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0257768
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0141893
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.025555
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0141893
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0395989
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0141486
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0399303
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0141486
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0206119
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139645
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00740343
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00740343
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0346185
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0138897
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0344503
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0138897
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0255741
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0189463
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0252145
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0189463
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0183451
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0140451
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.018264
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0140451
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0255619
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0177778
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0254331
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0177778
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0261242
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0204421
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0262415
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204421
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0181109
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0133843
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0179983
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0133843
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0180469
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0131495
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0181257
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0131495
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.051453
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0130107
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.051136
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130107
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0260922
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0137355
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.026131
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0137355
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0471177
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.013521
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0469851
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.013521
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0264084
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0189863
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0263101
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0189863
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0183429
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0142971
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0182891
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0142971
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0260305
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0176696
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.026035
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0176696
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0263817
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0204826
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0265196
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204826
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0206002
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0132721
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0207465
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0132721
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0209776
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0134608
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0208451
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0134608
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0509455
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0131877
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.051043
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0131877
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0269029
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0164577
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0267322
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0164577
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0476312
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0163957
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0475097
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0163957
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0265623
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0189989
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0261455
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0189989
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0183726
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0138531
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0182006
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0138531
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0208836
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139857
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.020881
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0139857
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0261394
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0179143
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0260701
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0179143
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0273691
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0205218
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.026835
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205218
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0206903
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0135069
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0208085
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0135069
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0207295
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0131138
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0207954
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0131138
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0502095
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0132372
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0501882
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0132372
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0267657
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.014539
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0264914
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.014539
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0450491
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0144567
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0449909
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0144567
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0128625
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.248544
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0183806
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0128625
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0218736
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0142072
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0219043
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0142072
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0214139
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139711
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0214518
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0139711
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0175868
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0147305
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0117883
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0117883
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0215752
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0145179
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0122808
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0122808
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0216451
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0144896
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0215504
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0144896
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0396869
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0130023
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0396697
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130023
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0205571
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0165277
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0204813
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0165277
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0345216
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0135111
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0344576
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0135111
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0180337
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0195669
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0103536
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0103536
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0182657
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0140567
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0182046
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0140567
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0208692
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139931
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.020734
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0139931
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.017536
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0401623
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0100547
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0100547
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0205264
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139994
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00932029
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00932029
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0207948
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139254
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0207367
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0139254
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0230374
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0139541
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0231288
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0139541
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0128484
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0163312
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0126895
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0126895
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0207184
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0137957
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0205884
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0137957
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0234671
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0187834
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0118903
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0118903
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0182669
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0130065
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0182874
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130065
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0208888
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0132106
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0209783
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0132106
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0233607
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0392709
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00984869
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00984869
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0235873
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0204147
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00953173
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00953173
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0205309
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0132858
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0205956
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0132858
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0496015
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0132804
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.049952
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0132804
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0249592
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0156224
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0243947
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0156224
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0455417
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0124183
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0455554
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0124183
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0235716
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0187126
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0234893
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0187126
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0183034
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0129036
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0181709
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0129036
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0207876
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.012952
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0209868
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.012952
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.023281
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0394114
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0235331
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.023281
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0236728
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0205296
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0236153
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205296
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0206008
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.013046
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0208594
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.013046
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0497128
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0131208
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.049248
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0131208
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0253364
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0153381
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0241006
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0153381
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0456217
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0126164
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0457463
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0126164
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0182829
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0182514
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0182177
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0182177
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0182543
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0138252
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0179566
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0138252
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0207458
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0130639
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0207993
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0130639
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0178714
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0391006
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.017693
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.017693
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0121242
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0204369
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0121051
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0121051
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0205675
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0129417
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0207543
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0129417
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0206818
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0133689
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0206909
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0133689
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0150985
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0153746
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0151022
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0150985
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0234005
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0123093
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0233522
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123093
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0204722
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0202851
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0119269
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0119269
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0206746
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.014544
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0206028
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.014544
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0232914
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0161681
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0232908
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0161681
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0205368
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0317129
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0206106
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0205368
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0126419
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0169712
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0126099
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0126099
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0234064
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0135335
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0232562
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0135335
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0235148
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0138394
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0233064
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0138394
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0232921
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0135385
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0235683
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0135385
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0317138
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0155214
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0117521
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0117521
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0203823
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0199543
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0205616
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0199543
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0205016
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0138909
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0205094
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0138909
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0235487
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0164069
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0233574
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0164069
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0204127
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0313088
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0205891
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0204127
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0126442
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0164648
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0127162
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1000 Time: 0.0126442
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0233992
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0127291
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.00726606
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00726606
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0231732
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0126408
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 0 Time: 0.0234371
[11/24/2022-12:08:20] [V] [TRT] Fastest Tactic: 1002 Time: 0.0126408
[11/24/2022-12:08:20] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:20] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1000 Time: 0.0235304
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:20] [V] [TRT] Tactic: 1002 Time: 0.0124983
[11/24/2022-12:08:20] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0235892
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0124983
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(633 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.012139
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0155118
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00733989
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00733989
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.012629
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011827
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0126602
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.011827
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0152613
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121684
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0152334
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121684
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0150286
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123451
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0152059
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123451
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127314
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119722
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0129211
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119722
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0128491
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120659
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0128629
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120659
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0151529
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121619
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0151237
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121619
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0150697
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012189
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0151397
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.012189
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0145641
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118298
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0146816
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118298
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0135256
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117612
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.01343
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117612
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(630 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0144608
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117271
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0141415
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117271
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(36960,1,3360,160) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(9240,1:4,840,40) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(18480,231:2,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:8,420,20) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,1:16,210,10) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(9240,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(1155,231:32,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(221760,1,20160,960) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(55440,1:4,5040,240) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(221760,231,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(110880,231:2,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(27720,1:8,2520,120) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(13860,1:16,1260,60) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(6930,231:32,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0124743
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118185
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125672
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118185
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0126968
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119981
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.012632
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119981
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00743634
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0891749
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0097984
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00743634
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00955977
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120389
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00686498
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00686498
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.012517
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121204
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00882205
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00882205
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0126072
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121482
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125543
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121482
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0176889
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116283
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0177295
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116283
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00992823
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117623
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00604381
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00604381
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,231,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0153339
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116026
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0154011
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116026
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0125558
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0125855
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125284
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0125284
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00968259
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117007
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0096771
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0096771
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127208
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116905
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125912
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116905
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0126987
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120834
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0127379
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120834
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00962225
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117633
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00956495
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00956495
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.009514
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118864
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00959695
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.009514
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0213969
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011776
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0215543
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.011776
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127611
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121097
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0127939
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121097
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(73920,1,6720,320) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0207367
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119307
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.020578
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119307
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127208
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0129691
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125131
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0125131
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00961493
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121684
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00960945
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00960945
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0125924
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011952
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125105
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.011952
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0128469
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012347
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0128926
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.012347
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100459
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121444
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0101906
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100459
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100373
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120259
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0101181
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100373
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0209143
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119829
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.020832
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119829
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127859
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119718
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0128808
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119718
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(18480,1:4,1680,80) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0206687
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123581
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0208131
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123581
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.012712
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012832
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0124286
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0124286
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00967619
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116304
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00978529
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00967619
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100474
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120366
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100596
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100474
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0128465
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117971
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0125074
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117971
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127832
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123467
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0127124
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0123467
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100748
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120994
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0101349
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100748
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.010044
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117486
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100642
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.010044
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0206681
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0115889
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.020785
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115889
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127261
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117514
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.012837
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117514
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(2310,231:32,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0199091
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117218
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.019848
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117218
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00758063
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0867703
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00950657
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00758063
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121916
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0111131
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0118963
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111131
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121916
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119269
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0120606
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119269
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00924029
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0115481
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00685584
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00685584
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121832
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0124118
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00881694
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00881694
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121204
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0120095
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.012
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0176889
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118569
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0175878
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118569
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100962
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122309
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00989714
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00989714
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(73920,231,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0154359
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122964
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0153349
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122964
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00959299
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118217
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00677818
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00677818
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00976731
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116881
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00973897
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00973897
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100946
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119299
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0102854
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100946
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00925229
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0184074
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00681404
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00681404
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00994834
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116835
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00676177
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00676177
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100437
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118147
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100297
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0100297
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0117141
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118133
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0117324
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0117141
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00865748
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012344
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00845069
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00845069
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(36960,231:2,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.01161
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120339
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0115861
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0115861
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0122385
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118484
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00747131
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00747131
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00966187
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120728
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0096832
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00966187
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.010112
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121166
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.010208
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.010112
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121604
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0174883
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00690612
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00690612
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0122682
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121181
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0069588
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0069588
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100958
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119634
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100203
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0100203
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0207863
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0125802
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0209731
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0125802
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0127345
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120415
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.012683
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120415
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(9240,1:8,840,40) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0205989
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0124823
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0206198
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0124823
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0123227
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118966
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0122133
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118966
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00964693
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119493
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00953356
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00953356
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0101245
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120693
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100986
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0100986
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121082
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0177143
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0121531
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0121082
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0124834
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.012315
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.011989
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00992396
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123413
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100297
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00992396
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0207347
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122659
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0207497
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0122659
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0126453
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121017
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0126861
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121017
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(4620,1:16,420,20) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0206935
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121512
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0205433
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121512
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00966248
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120659
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0096576
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0096576
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00970514
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011693
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00963718
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00963718
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100891
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117517
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0101876
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100891
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00959939
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0177793
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.009354
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.009354
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00748
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011979
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00736206
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00736206
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100139
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121619
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00985143
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00985143
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100102
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123581
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0102096
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100102
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00900771
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121973
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00899143
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00899143
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Half(2310,231:32,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0119855
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120004
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0121261
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119855
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0099008
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0127189
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00700778
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00700778
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00998461
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0114841
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00997333
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00997333
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.011783
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122343
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0119383
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.011783
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00990933
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0160295
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00993189
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00990933
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00799035
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116818
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00816584
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00799035
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0118973
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0124118
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0119787
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0118973
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0118731
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012147
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0117697
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0117697
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0121242
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118266
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0121276
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118266
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(18480,231:4,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0152411
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122739
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00640119
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00640119
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00988495
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0127497
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100123
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00988495
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100913
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0115429
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0099651
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0099651
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0120282
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119844
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.011828
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.011828
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00979931
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0151451
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0101096
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00979931
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00877365
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0115829
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00854319
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00854319
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0117524
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117813
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00603162
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00603162
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.011915
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118892
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0120686
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118892
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0122781
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117915
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0122461
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117915
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Int8(2310,231:32,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(656 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00756572
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0124248
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00693486
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00693486
[11/24/2022-12:08:21] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00695401
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118375
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00696337
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00695401
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00718423
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119413
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.007136
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.007136
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00615181
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0314798
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00673912
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00615181
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00672748
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122514
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00601581
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00601581
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0069181
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.012565
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00655106
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00655106
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00700278
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123539
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00701649
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00700278
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00939714
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121787
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00931457
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00931457
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00691418
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117647
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00572288
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00572288
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,231,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00922143
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119124
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00907828
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00907828
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00779621
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120293
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00766725
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00766725
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00699341
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0123661
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00651906
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00651906
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00761335
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0116128
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.007584
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.007584
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00814679
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120069
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00812851
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00812851
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00665787
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118738
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00661756
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00661756
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00661444
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0121501
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00662296
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00661444
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100849
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117992
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0100952
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100849
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00860128
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011878
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00861607
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00860128
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,2016,96) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00989867
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011955
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0098688
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.0098688
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0081407
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118375
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00787272
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00787272
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0067626
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117401
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00671917
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00671917
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0079967
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118154
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00774761
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00774761
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00862521
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0117208
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00837994
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00837994
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00689437
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0122804
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00678836
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00678836
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00689263
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.011992
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00693529
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00689263
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.0100806
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119886
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.0101007
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100806
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00897886
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0119529
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.008736
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.008736
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,504,24) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00981608
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118625
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00990293
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00981608
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00795073
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120377
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00807441
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00795073
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00660634
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118597
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00672603
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 1000 Time: 0.00660634
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00704109
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0120011
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00689676
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00689676
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00822781
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1002 Time: 0.0118182
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 0 Time: 0.00795683
[11/24/2022-12:08:21] [V] [TRT] Fastest Tactic: 0 Time: 0.00795683
[11/24/2022-12:08:21] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:21] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:21] [V] [TRT] Tactic: 1000 Time: 0.00843187
[11/24/2022-12:08:21] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120926
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00865022
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00843187
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0068935
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0118583
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00685823
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00685823
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00689916
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0122663
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00670047
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00670047
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0100498
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0117665
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0100916
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100498
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00859106
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119375
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00859106
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00859106
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(693,231:32,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00985173
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012104
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00979109
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00979109
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00610724
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0307392
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00648646
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00610724
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00695293
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0116396
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00694835
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00694835
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00706873
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0118432
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00695771
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00695771
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00658971
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119478
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00564571
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00564571
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00689676
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0125501
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00648626
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00648626
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00690373
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0122225
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00708702
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00690373
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.009374
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120629
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00929286
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00929286
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00694095
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0117289
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0070265
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00694095
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(22176,231,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00929829
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.011763
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00915429
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00915429
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00666514
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0115731
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00586002
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00586002
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00669756
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012408
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00684299
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00669756
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00686171
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119874
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00703761
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00686171
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00662047
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.011976
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00585454
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00585454
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.007008
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0122396
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00584594
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00584594
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00697056
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012051
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00684691
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00684691
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00717303
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119474
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00714606
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00714606
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00643299
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120476
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00665787
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00643299
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,231:2,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00711314
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0121764
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00717806
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00711314
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00822502
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0117992
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0061899
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0061899
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00674244
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120248
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00651325
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00651325
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00714754
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.011821
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00680533
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00680533
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00762346
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012003
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00600819
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00600819
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00833473
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119208
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00576018
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00576018
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00685932
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012027
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00686585
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00685932
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00995566
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120168
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.010052
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00995566
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00886427
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120632
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00867092
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00867092
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,252,12) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00998034
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0122366
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0099837
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00998034
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00805816
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0115098
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00849049
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00805816
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00676758
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119779
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00654171
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00654171
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00692767
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119573
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0067414
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0067414
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00755513
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0117644
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00758568
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00755513
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00819784
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0123257
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00837536
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00819784
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00688675
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0122773
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0068541
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0068541
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0100709
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120015
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0100693
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0100693
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00875697
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0121029
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00876773
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00875697
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(1386,1:16,126,6) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0099968
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012413
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0100465
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0099968
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00700778
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0115696
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00729554
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00700778
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00670275
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119764
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00665475
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00665475
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00698231
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012133
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00682362
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00682362
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00681034
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0118811
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00710117
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00681034
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00633441
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120465
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00641113
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00633441
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00696468
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012061
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00668281
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00668281
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00680425
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0123992
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0068234
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00680425
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00676135
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120968
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00677693
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00676135
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(693,231:32,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00739177
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120697
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00748
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00739177
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00691091
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.011769
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00592841
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00592841
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00700757
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0115896
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00694596
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00694596
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00698928
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120156
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00704
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00698928
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00683733
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0114817
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00697643
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00683733
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00633978
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119973
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00631235
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00631235
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00703216
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0116881
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0071262
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00703216
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00696838
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.011808
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00700495
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00696838
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00762466
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0116441
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00727451
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00727451
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(5544,231:4,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00947714
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119611
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00548402
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00548402
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00687869
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0121371
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00695358
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00687869
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00689633
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.012064
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00691788
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00689633
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0071792
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0119524
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00705742
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00705742
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00684691
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0115696
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00698318
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00684691
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00662171
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0113913
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00650216
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00650216
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00699015
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0117996
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00518939
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00518939
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00692746
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120465
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00708811
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.00692746
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00738194
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120225
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00727566
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00727566
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Int8(693,231:32,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(659 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00678836
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0120724
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00655086
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00655086
[11/24/2022-12:08:22] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0274903
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.029216
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0276663
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0274903
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0485775
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0313865
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.048448
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0313865
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.66818
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.101751
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.63287
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.101751
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.00952543
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.237527
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.00939228
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.00939228
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0196303
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0196303
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0323456
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0366949
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0323291
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0323291
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0534933
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0367051
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0532632
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0367051
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.63571
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0982789
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 2.11968
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0982789
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0147008
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.01699
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0143015
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0143015
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0233424
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0233424
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0322331
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0367406
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.032437
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0322331
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.053059
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0367109
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.053379
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0367109
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.62798
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0984183
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.63798
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0984183
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0144841
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.021361
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0143323
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0143323
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.02712
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.02712
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0317531
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0362663
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0322039
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0317531
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0531459
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0369554
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0529249
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0369554
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.6204
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0986286
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.63885
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0986286
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0142221
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0256145
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0140335
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0140335
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0219912
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0219912
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0235513
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.292951
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0233515
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0233515
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0396206
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.114519
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0387371
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0387371
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.64522
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.102619
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.64047
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.102619
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0114525
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0114525
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0353801
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.100391
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0332425
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0332425
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0271726
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.10875
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0274309
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0271726
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0482331
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0305198
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0486034
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0305198
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.65659
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0797897
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.67326
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0797897
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0103589
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.180343
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0101026
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0101026
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0198594
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0198594
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0274499
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.109081
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0273905
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0273905
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0483413
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0528259
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0486324
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0483413
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.60843
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.104926
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.61669
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.104926
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0121547
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.033131
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0121301
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0121301
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.017976
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.017976
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0306313
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.109358
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0305179
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0305179
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0519177
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0499733
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0520579
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0499733
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 1.62629
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0984594
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 1.63778
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1002 Time: 0.0984594
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0128297
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.0302519
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.013317
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0128297
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0230015
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0230015
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0306926
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1002 Time: 0.109319
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 0 Time: 0.0307557
[11/24/2022-12:08:22] [V] [TRT] Fastest Tactic: 1000 Time: 0.0306926
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:22] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:22] [V] [TRT] Tactic: 1000 Time: 0.0520396
[11/24/2022-12:08:22] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0497036
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0523246
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0497036
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.61783
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0991863
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 1.62425
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0991863
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0125044
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0321134
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0128541
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0125044
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.024915
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.024915
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0287031
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.108709
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0288859
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0287031
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0504076
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0500053
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0504716
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0500053
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.62026
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0998949
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 1.61969
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0998949
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0119585
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0302446
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0125783
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119585
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0202171
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0202171
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0233482
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.105038
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.023345
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.023345
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0233025
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.118121
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0231523
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0231523
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.645
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.102613
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 1.62065
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.102613
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0115928
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0115928
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0411166
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0810126
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0353874
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0353874
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.049408
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.109605
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0497798
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.049408
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0699078
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.123115
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0673067
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0673067
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0859886
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.117497
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0847566
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0847566
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0474594
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0474594
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0976229
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0835383
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0988869
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0835383
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0234606
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0170057
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0234175
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0170057
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.027549
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.027549
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.048765
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.048765
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.63349
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 1.63349
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0194
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0194
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0278811
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0278811
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0495832
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0495832
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.15861
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 1.15861
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0114549
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0202766
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0113118
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0113118
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0182851
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0182851
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0272831
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0272831
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0489676
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0489676
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.11664
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 1.11664
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0114704
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0205616
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0113899
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0113899
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0176477
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0176477
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0241074
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0241074
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0284389
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.103975
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0283299
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0283299
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0414629
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0977851
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0265196
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0265196
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 1.13189
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0816891
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 1.13827
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0816891
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(660 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0116156
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0116156
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(1:4,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1:8,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(88704:32,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00646281
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0134275
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00660655
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00646281
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00665995
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0131736
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00661382
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00661382
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00537837
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117215
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00600629
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00537837
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00644432
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.011603
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00510335
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00510335
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00667345
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117275
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00505994
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00505994
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00668197
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117619
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00665558
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00665558
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00944514
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0114792
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00944743
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00944514
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00672893
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0116934
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00483093
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00483093
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.009204
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118147
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00909714
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00909714
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00809168
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.011481
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00798933
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00798933
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00640517
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117342
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00649024
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00640517
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00803378
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.01127
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.007904
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.007904
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00795987
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0113983
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00783808
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00783808
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00637237
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0114296
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00679896
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00637237
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00705872
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119924
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00707374
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00705872
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0122838
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118389
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0121981
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118389
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00914286
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118762
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00922886
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00914286
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0119208
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121299
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0118917
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0118917
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00899343
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121611
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00920686
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00899343
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00712686
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121463
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0070683
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0070683
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00914314
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0123013
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00905457
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00905457
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00918514
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.012107
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00929657
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00918514
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00724389
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120884
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00733623
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00724389
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00707875
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121642
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00719406
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00707875
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0120827
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121912
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0122251
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0120827
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00933114
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119695
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00921828
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00921828
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0119154
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0122735
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.011941
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119154
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00910628
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119844
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.009114
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00910628
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00692702
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119821
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00696729
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00692702
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00716206
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119794
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00741554
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00716206
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00915457
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117507
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.009124
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.009124
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00917543
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117278
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.009218
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00917543
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00711118
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118393
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00718949
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00711118
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00711859
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119768
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00726149
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00711859
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0121528
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118586
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0121745
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118586
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00911486
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120362
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00923971
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00911486
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0118924
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119752
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0118386
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0118386
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00644611
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0116821
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00673122
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00644611
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00671834
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0112141
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00676218
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00671834
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00682645
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119448
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00690569
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00682645
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00681208
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119585
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00584613
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00584613
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00685976
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119432
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00603029
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00603029
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0068295
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119627
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00693878
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0068295
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0100011
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119623
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00996206
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00996206
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00709791
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0115706
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0070622
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0070622
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0097856
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117915
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00998339
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0097856
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00686911
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0115882
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00581303
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00581303
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00686237
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118745
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00704588
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00686237
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00717029
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118593
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00725143
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00717029
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00701823
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.013622
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00591945
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00591945
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00700386
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120949
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00573001
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00573001
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.007192
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120735
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00722651
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.007192
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00764848
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120293
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00744274
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00744274
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00676447
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117996
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00656873
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00656873
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00769516
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121935
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00730857
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00730857
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00686541
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.011776
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00561442
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00561442
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00679418
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.011731
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.007176
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00679418
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00714743
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119844
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0073632
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00714743
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00698035
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0131503
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00569002
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00569002
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00700648
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118404
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00543153
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00543153
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00696446
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119139
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00714971
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00696446
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0102188
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117345
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0102962
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0102188
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0074528
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120518
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00743383
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00743383
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0100651
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121131
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0101425
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100651
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00682166
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118238
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00706264
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00682166
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00672249
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119977
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00700343
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00672249
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00717143
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.012
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00722103
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00717143
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00680332
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0132522
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00714583
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00680332
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0068985
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.011931
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00725097
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0068985
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00709203
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0121341
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0070252
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0070252
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0102939
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120099
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0105345
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0102939
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00736571
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119261
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00741554
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00736571
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0101318
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120705
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0100894
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0100894
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00688087
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0118643
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00723726
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00688087
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00691679
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0117
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00698493
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00691679
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0072576
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119557
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00726011
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0072576
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00696446
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0129196
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00699167
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00696446
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00680882
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0119543
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.0066986
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0066986
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00727063
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120705
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00730697
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00727063
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0071262
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.011933
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00711967
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00711967
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.0069268
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120392
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00703935
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.0069268
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00858057
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0120072
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00850474
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00850474
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00703782
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0114226
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00615238
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00615238
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00712533
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0116501
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00713578
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 1000 Time: 0.00712533
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1000 Time: 0.00746766
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 1002 Time: 0.0123451
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:23] [V] [TRT] Tactic: 0 Time: 0.00743474
[11/24/2022-12:08:23] [V] [TRT] Fastest Tactic: 0 Time: 0.00743474
[11/24/2022-12:08:23] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:23] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:23] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00703565
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0116237
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0071003
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.00703565
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00668696
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0114729
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00642802
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00642802
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00756018
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0118196
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00741829
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00741829
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.007472
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0117662
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00741554
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00741554
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0088796
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0119295
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00883361
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00883361
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0100111
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.012048
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00560352
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00560352
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00723246
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0116164
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00711771
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00711771
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00716023
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0116135
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00722331
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.00716023
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00742103
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0120255
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00736046
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00736046
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00716571
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0117036
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00703216
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00703216
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00672623
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0117957
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00673642
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.00672623
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00749029
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0114423
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00516735
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00516735
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00736183
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0115109
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00743269
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.00736183
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00881291
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0113164
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00893203
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.00881291
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(667 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.00666971
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0116716
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.00650701
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.00650701
[11/24/2022-12:08:24] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.034229
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0350985
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0348297
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.034229
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0631009
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0355803
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0631573
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.0355803
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 2.18348
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.132073
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 2.18615
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.132073
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0100023
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0123112
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0100407
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100023
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0389691
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0389691
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0404594
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0678065
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0405817
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0404594
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0692389
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.135216
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0692099
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0692099
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 2.1617
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.127902
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 2.18705
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.127902
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0159104
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0201011
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0161615
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0159104
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.039376
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.039376
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0401909
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0678004
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0403349
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0401909
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0692571
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.13437
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0690347
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0690347
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 2.18378
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.128014
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 2.21307
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.128014
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.016127
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.017908
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0165018
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.016127
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0307081
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0307081
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0392103
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0668495
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0396789
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0392103
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0684069
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.133831
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.068192
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.068192
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.5042
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.125081
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.49764
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.125081
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0156398
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0248922
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0155973
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0155973
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0300553
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0300553
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0285067
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.574318
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0286565
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0285067
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0493745
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.148663
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0487345
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0487345
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.50389
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.129598
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.50057
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.129598
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0118931
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0118931
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0462103
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.129703
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0459737
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0459737
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0337307
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.142402
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0332727
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0332727
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0624929
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0333257
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0623253
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.0333257
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.49123
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0894971
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.49141
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.0894971
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0099139
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.02472
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0101294
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0099139
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0259672
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0259672
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0339319
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.141762
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0339794
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0339319
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0626575
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.131182
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0623436
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0623436
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.47725
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.396096
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.49398
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.396096
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0123124
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.028195
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0119067
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0119067
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0289673
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0289673
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0355895
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.141909
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0354496
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0354496
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0640945
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.131685
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0640594
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0640594
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.49411
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.394546
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.49424
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.394546
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0128446
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0303168
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0131304
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0128446
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.030592
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.030592
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0355886
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.141813
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0355291
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0355291
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0642453
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.131241
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0645181
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0642453
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.4952
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.394949
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.49789
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.394949
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0127139
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0299648
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.012989
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0127139
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0272061
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0272061
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0355529
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.141995
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0356005
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0355529
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0645181
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.131449
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0644465
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0644465
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.49314
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.393723
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.49005
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.393723
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0128152
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0286629
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0128023
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0128023
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.028736
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.028736
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0288905
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.1368
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0285714
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0285714
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0352192
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.154167
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.033099
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.033099
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.50643
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.130032
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 1.50456
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.130032
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0119699
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119699
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.048189
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.104469
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0482758
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.048189
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0471291
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.140151
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0473257
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0471291
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0777417
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.157723
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.081904
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0777417
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0962949
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.150651
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0976846
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0962949
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0401326
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0401326
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.08848
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.104606
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0877829
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0877829
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0289435
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0176975
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0287269
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1002 Time: 0.0176975
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0340663
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0340663
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0627307
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0627307
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.51325
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 1.51325
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0271832
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0271832
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0352055
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0352055
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0638507
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0638507
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.51321
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 1.51321
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.01359
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0213198
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0135356
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0135356
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0245737
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0245737
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0350519
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0350519
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0638613
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.0638613
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 1.51792
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 1.51792
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.0135514
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1002 Time: 0.0324416
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 0 Time: 0.0135144
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0135144
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:24] [V] [TRT] Tactic: 1000 Time: 0.026835
[11/24/2022-12:08:24] [V] [TRT] Fastest Tactic: 1000 Time: 0.026835
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:24] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:24] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:24] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0367737
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0367737
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.059491
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.137799
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0580937
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0580937
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0780297
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.127911
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0456914
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0456914
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 1.52302
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.106315
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 1.53019
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.106315
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(668 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0145381
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0145381
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,924,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1,1344,32) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(7392,1:4,336,8) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(29568,924,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,924:2,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,1:8,168,4) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(7392,924:4,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00926829
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0160254
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00936886
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00926829
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00964267
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0160168
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00963474
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00963474
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00735086
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113428
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0096835
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00735086
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00952869
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115907
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00686215
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00686215
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00954484
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115812
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00705981
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00705981
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0113378
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117415
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0113347
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0113347
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0224921
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0112904
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0224927
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112904
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0098112
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115657
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00517894
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00517894
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0161087
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0111044
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0160589
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111044
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0114532
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0162768
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112802
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0112802
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00964937
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0160676
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00964907
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00964907
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0114841
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0111434
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.011232
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111434
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0114419
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114215
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.011367
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.011367
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00960091
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115763
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00961158
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00960091
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112974
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115647
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.011206
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.011206
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0259063
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113994
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0260571
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113994
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0114514
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115168
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0113853
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0113853
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0191869
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117683
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0192354
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117683
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0113618
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0161244
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112668
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0112668
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00956587
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0158533
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00968259
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00956587
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0113125
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116125
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112953
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0112953
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0114268
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0118456
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0114486
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0114268
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112313
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116944
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112774
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112313
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0118411
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116213
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0116891
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116213
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0256952
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.011603
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0261691
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.011603
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0115953
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0127962
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0114894
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0114894
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0197057
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0119691
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0195674
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0119691
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0136349
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0160924
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0137313
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0136349
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00956891
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0158089
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00954636
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00954636
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.011219
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0157902
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112499
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.011219
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0136054
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114131
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0136569
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114131
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.013659
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115752
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0136411
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115752
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112679
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115481
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0113122
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112679
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0116916
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117707
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0116719
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0116719
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.026643
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115541
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0267421
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115541
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0137571
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117233
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0136981
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117233
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0203183
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116691
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.020416
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116691
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00744229
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0110811
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00960488
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00744229
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00935629
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0110242
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00942657
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00935629
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00958659
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115056
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00971032
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00958659
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.009386
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115196
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00681099
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00681099
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00951314
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.011616
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00703695
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00703695
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0108059
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115745
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0107207
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0107207
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0223621
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116294
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0223974
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116294
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0100038
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116469
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0100766
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100038
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0160569
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115608
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0160457
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115608
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00955703
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0112144
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00656021
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00656021
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00959238
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113867
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00962591
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00959238
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112292
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116607
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112549
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112292
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00926971
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0209881
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00656125
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00656125
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0100309
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114866
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00555886
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00555886
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0115534
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116645
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.011578
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0115534
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0137899
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116793
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0138265
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0116793
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00752313
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116213
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00762009
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00752313
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112651
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117545
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112862
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112651
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00960244
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113083
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00583406
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00583406
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00965364
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.011603
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00964815
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00964815
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0111606
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114391
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0113755
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0111606
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00940743
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0201491
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00532538
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00532538
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00975756
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0116958
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00530201
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00530201
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0116874
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114908
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0115844
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114908
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0243261
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115014
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0243604
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115014
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0116188
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0120236
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0115066
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0115066
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0181194
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117665
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0181697
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0117665
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00968229
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114968
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00963688
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00963688
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00959025
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114546
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0095872
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0095872
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112271
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115974
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112855
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112271
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.009468
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0199217
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00951857
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.009468
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00977829
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.011642
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00980998
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00977829
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0104049
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0126537
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0103749
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0103749
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0245219
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114838
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0244236
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114838
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.011564
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0119223
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0115446
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0115446
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0182331
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0118597
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0181411
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0118597
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00965181
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115995
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00969051
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00965181
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0096512
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0111838
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00962194
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00962194
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0112461
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114891
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0112802
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0112461
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.009382
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0196886
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00947486
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.009382
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00736
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115513
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0072352
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0072352
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0103739
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115735
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0100486
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0100486
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0116283
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113955
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0115432
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113955
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00845203
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115763
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00845634
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00845203
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0118745
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0115432
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0116874
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0115432
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00981242
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0144375
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00687543
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00687543
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0100251
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0112063
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0102155
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100251
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0115956
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0129413
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0115052
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0115052
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00984289
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0174801
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00984198
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00984198
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00750994
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.011744
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00737029
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00737029
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0116135
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113709
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0115945
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113709
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.012701
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0112309
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0127642
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0112309
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0138735
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0113772
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0139636
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0113772
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.015851
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.011571
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00532555
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00532555
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00998613
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0142962
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00994529
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00994529
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.01021
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114152
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0104033
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.01021
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0115938
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.012979
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.011546
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.011546
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0101431
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0163952
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0102798
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.0101431
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00757847
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0112362
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00767615
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.00757847
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0115327
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0112468
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00508611
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00508611
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0128594
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0114571
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0126244
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0114571
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0140817
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0111487
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0141344
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0111487
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(683 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.00717074
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0117338
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.00549113
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00549113
[11/24/2022-12:08:25] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.126089
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0951269
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.128279
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0951269
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.208494
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0972023
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.209422
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.0972023
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 4.66008
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.373614
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 4.65705
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.373614
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0203691
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0234469
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.0201217
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.0201217
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.110389
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.110389
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.138343
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.262565
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.136377
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.136377
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.212389
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.532407
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.209957
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.209957
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 4.60836
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.492229
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 4.58967
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.492229
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.0304311
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1002 Time: 0.0358697
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 0 Time: 0.030347
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 0 Time: 0.030347
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:25] [V] [TRT] Tactic: 1000 Time: 0.137365
[11/24/2022-12:08:25] [V] [TRT] Fastest Tactic: 1000 Time: 0.137365
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:25] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:25] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.132642
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.264489
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.134679
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.132642
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.212754
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.5328
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.212503
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.212503
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.55276
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.492375
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 4.56511
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.492375
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.0309614
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.0365143
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.0307465
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.0307465
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.133435
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.133435
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.145467
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.264718
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.144078
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.144078
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.224023
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.532283
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.222295
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.222295
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.60387
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.491808
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 4.56116
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.491808
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.039352
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.0361429
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.0391291
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.0361429
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.152439
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.152439
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.117863
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 2.27525
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.119536
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.117863
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.213865
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.435026
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.213984
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.213865
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.56792
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.372553
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 4.57479
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.372553
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.0389577
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.0389577
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.182057
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.373993
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.182459
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.182057
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.117616
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.41611
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.115605
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.115605
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.198432
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.0927703
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.198245
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.0927703
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.50229
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.254619
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 4.50245
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.254619
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.0206041
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.0298213
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.0205342
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.0205342
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.104635
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.104635
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.118256
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.54656
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.11645
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.11645
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.198962
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.532229
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.196763
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.196763
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.50141
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 1.60358
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 4.5272
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 1.60358
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.0275848
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.0387989
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.0277128
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.0275848
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.101195
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.101195
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.123074
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.548558
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.113392
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.113392
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.193138
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.537737
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.195657
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.193138
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.52169
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 1.59967
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 4.49349
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1002 Time: 1.59967
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.0282766
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.0382766
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.028192
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.028192
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.0965851
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 1000 Time: 0.0965851
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.121952
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.548197
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.121289
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.121289
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 0.199735
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 0.536978
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 0 Time: 0.198423
[11/24/2022-12:08:26] [V] [TRT] Fastest Tactic: 0 Time: 0.198423
[11/24/2022-12:08:26] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:26] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1000 Time: 4.48569
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:26] [V] [TRT] Tactic: 1002 Time: 1.59986
[11/24/2022-12:08:26] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 4.49229
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1002 Time: 1.59986
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0290011
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0370137
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0283604
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0283604
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.103787
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.103787
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.122699
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.547557
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.12344
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.122699
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.197047
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.537422
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.197481
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.197047
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 4.49459
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 1.59998
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 4.46257
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1002 Time: 1.59998
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0283505
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0651657
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0283528
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.0283505
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.106978
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.106978
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.118857
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.534569
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.119616
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.118857
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.157449
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.452037
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.159077
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.157449
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 4.52718
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.373202
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 4.51499
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.373202
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0397314
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.0397314
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.181897
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.296178
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.176521
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.176521
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.183657
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.535758
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.177723
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.177723
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.238898
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.455835
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.23723
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.23723
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.288357
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.437093
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.286441
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.286441
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.107787
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.107787
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.257989
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.296146
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.255003
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.255003
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0973554
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0186577
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0972526
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.0186577
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.11411
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.11411
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.194683
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.194683
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 4.5601
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 4.5601
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.116361
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.116361
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.115605
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.115605
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.196558
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.196558
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 4.50999
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 4.50999
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0309952
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0354779
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0308288
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0308288
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.106265
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.106265
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.119938
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.119938
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.196544
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.196544
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 4.48458
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 4.48458
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0311899
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0554926
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0309979
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0309979
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.10027
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.10027
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.146235
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.146235
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.195881
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.395323
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.198971
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.195881
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.246217
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.365778
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.129861
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.129861
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 4.60901
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.301243
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 4.67712
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.301243
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(684 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0735383
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.0735383
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(118272:32,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(118272,1,2688,32) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(29568,1:4,672,8) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(118272,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(59136,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,336,4) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,4032,96) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,1008,24) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(88704,924,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(44352,924:2,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,504,12) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(5544,1:16,252,6) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Half(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Int8(2772,924:32,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00557538
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0110446
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00552264
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00552264
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00572727
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0113723
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00558523
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00558523
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00512833
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0111392
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00558857
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00512833
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00551332
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0113519
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0048704
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.0048704
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00556976
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115446
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00498585
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00498585
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00590299
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.012029
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00569477
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00569477
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00947857
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115502
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00941971
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00941971
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00576256
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115393
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00463558
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00463558
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,924,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00770767
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0117693
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00766412
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00766412
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00667408
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0111051
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00677652
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00667408
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00554391
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.011571
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00557996
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00554391
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00682471
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0112573
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00677319
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00677319
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00692049
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115358
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00691505
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00691505
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00561741
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115527
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00558822
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00558822
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00589787
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.011737
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00592073
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00589787
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00973227
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115474
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00981181
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00973227
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0069366
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0119033
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00693268
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00693268
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(22176,1,1008,24) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00913029
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0118625
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00900629
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00900629
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0068308
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0121128
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.0069157
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.0068308
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00552668
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0120571
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00565257
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00552668
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00699494
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0116754
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00689197
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00689197
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00693943
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0114447
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00695075
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00693943
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00585179
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0117173
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00588654
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00585179
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00668925
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0116223
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00629168
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00629168
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00980602
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0116452
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00982766
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00980602
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.0069342
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0119436
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00689219
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00689219
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(5544,1:4,252,6) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00922029
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0118316
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.009032
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.009032
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00730469
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115794
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00728343
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00728343
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00547082
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0116146
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00554022
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00547082
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00580389
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0116645
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00578761
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00578761
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00731291
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0116656
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00725234
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00725234
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00742354
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0114708
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00725394
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00725394
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1000 Time: 0.00583333
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 1002 Time: 0.0115559
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:27] [V] [TRT] Tactic: 0 Time: 0.00591781
[11/24/2022-12:08:27] [V] [TRT] Fastest Tactic: 1000 Time: 0.00583333
[11/24/2022-12:08:27] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:27] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:27] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00644114
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114437
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00622907
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00622907
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.0110005
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114458
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.0111022
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.0110005
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00740046
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117268
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00739634
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00739634
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(924,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00955825
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116178
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00934971
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00934971
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00508674
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0113407
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00540868
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00508674
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00545016
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0112081
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00545134
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00545016
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00551525
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0112946
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00558119
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00551525
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00544542
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117215
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.0046835
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0046835
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00546252
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117092
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00504118
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00504118
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00555833
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117254
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00552299
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00552299
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00949543
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115622
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00933828
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00933828
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00585637
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116005
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00583479
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00583479
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(22176,924,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00761143
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117032
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00767807
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00761143
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00555727
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0113213
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00473364
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00473364
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00566453
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114194
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00551455
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00551455
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00594286
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115615
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00593993
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00593993
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.0054102
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0120251
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00467067
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00467067
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00569301
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117806
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00484739
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00484739
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00610457
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115981
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00611638
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00610457
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00690525
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116178
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00690547
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00690525
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00544457
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.011952
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00553969
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00544457
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,924:2,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00672852
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.011917
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00678192
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00672852
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00583387
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115963
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00470665
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00470665
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00559525
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114381
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00563446
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00559525
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00599333
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117335
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00594231
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00594231
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00589769
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117394
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00468866
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00468866
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00596552
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114964
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00482408
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00482408
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00621615
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116476
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00610667
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00610667
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00956983
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115545
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00961615
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00956983
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00655501
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115949
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00646062
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00646062
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(2772,1:8,126,3) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00837232
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115928
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00884249
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00837232
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00589842
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116522
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00599676
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00589842
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00551578
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114075
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00551771
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00551578
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00595886
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.011699
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00582912
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00582912
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00584594
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0120579
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00578048
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00578048
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00592933
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115587
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00598019
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00592933
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00566752
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115207
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00580078
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00566752
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00962225
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115573
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00962377
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00962225
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00648368
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0118365
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00651179
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00648368
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1848,1:16,84,2) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00886077
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115397
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00876316
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00876316
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.0058816
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0113284
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.0059739
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.0058816
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00551596
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115499
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00550681
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00550681
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00585655
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115186
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00579986
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00579986
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00587136
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0118221
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00579749
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00579749
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00537888
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0113952
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00555727
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00537888
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00553758
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116076
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00566541
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00553758
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00618857
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115608
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.006148
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.006148
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00558506
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117542
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00578524
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00558506
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(924,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00680577
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117148
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00688588
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00680577
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00572032
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117236
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00486598
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00486598
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.0057547
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115116
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00570549
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00570549
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00663127
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116582
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00632507
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00632507
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00576366
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0111884
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.0058677
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00576366
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00546218
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.01182
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00553864
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00546218
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00653299
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116139
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00628154
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00628154
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00668862
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115133
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00670816
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00668862
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00699494
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0115429
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00705742
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00699494
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(5544,924:4,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00831568
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117268
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00457029
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00457029
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00580699
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0111321
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00577115
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00577115
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00588416
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.011526
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00585472
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00585472
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00657288
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0121825
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00622095
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00622095
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00582016
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0113519
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.0057536
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.0057536
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00559138
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0114985
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00563745
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00559138
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00646837
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0117855
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00473674
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00473674
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00671792
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0116104
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00678919
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00671792
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00710465
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.0113983
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00713121
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1000 Time: 0.00710465
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(924,924:32,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(715 -> <out>) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.00564026
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.011571
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.00471535
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.00471535
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1,2016,24) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(22176,1:4,504,6) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(88704,3696,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,3696:2,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(11088,1:8,252,3) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(7392,1:16,168,2) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(22176,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(3696,3696:32,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(1:4,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(1:8,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(354816:32,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.83656
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.336855
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 1.8675
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.336855
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.71196
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.342089
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 1.70814
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.342089
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.57804
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.339776
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 1.57808
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.339776
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.387867
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.350171
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.566053
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.350171
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.461582
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.445435
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.350135
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.350135
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.64555
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.263584
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.349445
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.263584
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.6405
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.263387
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 1.65794
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.263387
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.21659
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.274459
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 1.2168
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.274459
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.509106
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.226926
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.203328
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 0 Time: 0.203328
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 1.03477
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.226272
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 1.03504
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.226272
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.984073
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.335982
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.980951
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.335982
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.483177
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.342606
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.483163
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.342606
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 2.17057
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.340882
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 2.16034
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.340882
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.956517
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.314427
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.956261
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.314427
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.954798
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.451817
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 0 Time: 0.95387
[11/24/2022-12:08:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.451817
[11/24/2022-12:08:28] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:28] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1000 Time: 0.474377
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:28] [V] [TRT] Tactic: 1002 Time: 0.248978
[11/24/2022-12:08:28] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.472718
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.248978
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.474053
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.25067
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.473554
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.25067
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.71704
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.250967
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.67364
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.250967
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.940119
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.236946
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.934523
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.236946
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.52695
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.23429
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.52807
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.23429
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.988375
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.334999
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.989737
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.334999
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.48528
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.343561
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.483351
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.343561
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 2.1777
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.34144
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 2.32071
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.34144
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.961943
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.315205
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.95979
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.315205
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.960439
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.447538
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.958103
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.447538
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.552192
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.250327
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.551214
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.250327
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.55253
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.252238
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.552165
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.252238
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.67374
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.250546
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.67403
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.250546
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.937435
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.271671
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.943314
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.271671
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.53261
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.272562
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.53152
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.272562
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.856215
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.337915
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.855904
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.337915
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.496983
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.342761
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.497029
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.342761
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.558304
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.341499
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.555886
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.341499
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.834734
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.308933
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.838706
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.308933
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.841522
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.436837
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.839054
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.436837
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.553166
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.250578
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.553138
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.250578
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.553495
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.250176
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.553687
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.250176
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.60678
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.251077
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.62713
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.251077
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.830016
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.244878
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.829531
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.244878
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.43312
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.245705
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.43349
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.245705
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.410889
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.351744
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.510482
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.351744
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.29691
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.278839
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.29433
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.278839
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.30997
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.278624
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.3125
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.278624
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.52795
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.277605
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 1.52791
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.277605
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 0.431872
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.232745
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.345362
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.232745
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.37382
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1002 Time: 0.204366
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 0 Time: 0.342775
[11/24/2022-12:08:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.204366
[11/24/2022-12:08:29] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:29] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:29] [V] [TRT] Tactic: 1000 Time: 1.36405
[11/24/2022-12:08:29] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.204398
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.36946
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.204398
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.16076
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.189019
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.1616
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.189019
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.526299
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.252219
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.525801
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.252219
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.979058
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.212183
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.979543
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.212183
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.458016
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.313001
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.342409
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.313001
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.939497
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.293897
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.939054
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.293897
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.03868
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.293385
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.03748
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.293385
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.53015
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.29109
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.53046
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.29109
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.4136
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 1.66592
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.30176
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 0 Time: 0.30176
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.03877
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.26795
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.302167
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.26795
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.04093
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.267931
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.03979
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.267931
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.611561
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.266414
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.611909
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.266414
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.289243
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.25547
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.288453
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.25547
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.521701
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.216224
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.521294
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.216224
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.843785
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.294418
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.289065
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 0 Time: 0.289065
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.487534
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.260302
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.488366
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.260302
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.558775
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.260037
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.558514
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.260037
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 2.02537
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.261669
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 2.01355
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.261669
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.840983
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 1.12071
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.244229
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 0 Time: 0.244229
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.839365
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.413495
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.221504
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 0 Time: 0.221504
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.518331
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.230944
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.518866
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.230944
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.60972
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.23312
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.61279
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.23312
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.828992
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.214688
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.829705
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.214688
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.44236
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.176233
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.44805
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.176233
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.844699
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.296663
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.849467
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.296663
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.487392
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.261051
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.487346
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.261051
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.558555
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.26043
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.558021
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.26043
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 2.01388
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.262391
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 2.02001
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.262391
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.837211
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 1.12103
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.834048
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 0 Time: 0.834048
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.837719
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.41056
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.83883
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.41056
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.518354
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.23157
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.518949
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.23157
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 1.60983
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.232219
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 1.61552
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.232219
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1000 Time: 0.829829
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 1002 Time: 0.215575
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:30] [V] [TRT] Tactic: 0 Time: 0.828475
[11/24/2022-12:08:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.215575
[11/24/2022-12:08:30] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:30] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:30] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 1.44327
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.175689
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 1.44423
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.175689
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.525312
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.282926
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.526318
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.282926
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.495685
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.265783
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.496311
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.265783
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.561435
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.257851
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.56176
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.257851
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 1.73019
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.283305
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 1.72943
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.283305
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.479913
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 1.16665
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.479936
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1000 Time: 0.479913
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.298501
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.39552
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.298341
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 0 Time: 0.298341
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.52037
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.229134
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.521239
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.229134
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.520466
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.228462
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.520713
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.228462
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.386907
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.214871
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.38859
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.214871
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.61557
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.174807
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.614199
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.174807
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.515941
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.285559
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.296137
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.285559
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.607749
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.233801
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.606464
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.233801
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.634894
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.282962
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.63563
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.282962
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 1.52462
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.249463
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 1.52653
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.249463
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.504169
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.606802
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.504128
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 0 Time: 0.504128
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.282574
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.260297
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.281321
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.260297
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.627671
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.215529
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.627369
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.215529
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.627589
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.214455
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.628302
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.214455
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.593847
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.213902
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.594281
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.213902
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.806962
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.29643
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.665664
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.29643
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.516795
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.256837
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.518034
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.256837
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.539031
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.232613
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.537106
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.232613
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.609518
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.275474
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.609298
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.275474
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 1.61152
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.249687
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 1.6173
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.249687
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.514158
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.572325
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.514254
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1000 Time: 0.514158
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.290309
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.222592
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.290153
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.222592
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.605627
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.176951
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.15205
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 0 Time: 0.15205
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.605952
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.177669
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.605499
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.177669
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.629975
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.17701
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.636521
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.17701
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.217952
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.296681
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.0860891
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 0 Time: 0.0860891
[11/24/2022-12:08:31] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.130693
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.050653
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.130759
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.050653
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.132142
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.051008
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.131945
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.051008
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.0543101
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.059104
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.0539916
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 0 Time: 0.0539916
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.0639147
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0612008
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.063872
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0612008
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.134656
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0408937
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.134391
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0408937
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.134926
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0404926
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.134837
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0404926
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.15845
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.042928
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.15861
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.042928
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.0691977
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0366434
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.0684968
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0366434
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.132809
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0340069
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.133253
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0340069
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.126789
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0527802
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.128581
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0527802
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.0653044
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0507109
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.065792
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0507109
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.112549
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0482712
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.113509
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0482712
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.114263
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0610682
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.114741
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0610682
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.0647634
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0383566
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.064867
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0383566
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.0648914
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0387371
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 0 Time: 0.0647086
[11/24/2022-12:08:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.0387371
[11/24/2022-12:08:31] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:31] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1000 Time: 0.216416
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:31] [V] [TRT] Tactic: 1002 Time: 0.0392526
[11/24/2022-12:08:31] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.216946
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0392526
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.100153
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0367851
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0998446
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0367851
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.188951
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0366503
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.189106
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0366503
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.128699
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.052992
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.128464
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.052992
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0654187
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.051325
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.065693
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.051325
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.113509
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.046848
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.116226
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.046848
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.115758
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0607269
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.113774
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0607269
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0744777
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0385063
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0750834
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0385063
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0749829
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0387326
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0747886
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0387326
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.216475
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0386423
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.217001
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0386423
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0994491
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0420331
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0987429
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0420331
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.189513
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0413246
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.189687
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0413246
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.113246
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0538225
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.113003
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0538225
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.067779
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0520945
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0674697
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0520945
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.075744
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.051872
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.075872
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.051872
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.104763
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0476678
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.105511
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0476678
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.10749
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.059776
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.104583
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.059776
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0753554
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.038832
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.074992
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.038832
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0750126
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0387497
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0754606
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0387497
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.209074
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0397314
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.208407
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0397314
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0996023
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0374297
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0996297
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0374297
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.181934
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.03824
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.183438
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.03824
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0576381
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0590278
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0577082
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1000 Time: 0.0576381
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.107198
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0416674
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.107127
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0416674
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.107817
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.042024
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.108018
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.042024
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0547307
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0351927
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.05568
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0351927
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.124087
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0307867
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.108361
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0307867
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.109136
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0307538
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.114078
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0307538
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.14405
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0295689
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.145467
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0295689
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0649051
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0366789
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0651078
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0366789
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.121214
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0310016
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.121479
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0310016
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0634118
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0479329
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.047872
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.047872
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0798949
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0436651
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0796137
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0436651
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0816526
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0435326
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0818331
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0435326
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.053693
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.158299
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0278827
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0278827
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.079488
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0365566
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0231033
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0231033
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0770217
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0390651
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0798972
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0390651
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0756457
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0380926
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0761006
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0380926
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0373086
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0372194
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0374663
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0372194
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0646324
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0311936
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0641889
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0311936
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.09632
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0419131
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0427131
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0419131
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0656
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0401051
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0659688
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0401051
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0758149
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.039688
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0758971
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.039688
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0951886
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.133673
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0248046
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0248046
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0957737
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0531931
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0248152
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0248152
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0686491
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.034997
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0678644
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.034997
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.19744
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0341339
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.197906
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0341339
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0958766
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.030965
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0968137
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.030965
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.1768
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.026301
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.176274
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.026301
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0968343
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0419943
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0965189
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0419943
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0659246
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.039512
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0656838
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.039512
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0759931
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0396023
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0756777
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0396023
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0957646
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.131563
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0956434
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0956434
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0960411
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0526583
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0959931
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0526583
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0675657
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0341339
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0675611
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0341339
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.197952
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0341605
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.198514
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0341605
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0964731
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0310839
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0963611
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0310839
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.177431
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.026349
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.176878
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.026349
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0626408
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0438811
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0629608
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0438811
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0676937
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.040912
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0673585
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.040912
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0761326
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.039496
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0765097
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.039496
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.055555
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.13851
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.055325
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.055325
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0338706
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0501196
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0337079
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0337079
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0666728
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0338862
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.066301
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0338862
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0682773
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0332489
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0690316
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0332489
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0429429
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0309358
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0431931
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0309358
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.07528
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0264503
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0748663
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0264503
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0672091
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0474811
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0378446
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0378446
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.076208
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0379966
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0755246
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0379966
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0832251
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0432949
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0833897
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0432949
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0641509
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0810857
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0643139
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1000 Time: 0.0641509
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0361874
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.03748
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0360411
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0360411
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0772823
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0315749
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0773897
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0315749
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0769303
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0314688
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0772092
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0314688
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0755177
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0318674
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0753943
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0318674
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.100149
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.041528
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0151854
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0151854
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0656869
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0431703
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0660678
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0431703
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0716571
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0388994
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0718789
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0388994
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0814606
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0435623
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0817851
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0435623
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0645501
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0765257
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0646248
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1000 Time: 0.0645501
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0362411
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0322752
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.036248
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0322752
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0775451
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0261562
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0140534
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0140534
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0776846
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0263916
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.0774103
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0263916
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1000 Time: 0.0805486
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 1002 Time: 0.0262743
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:32] [V] [TRT] Tactic: 0 Time: 0.080688
[11/24/2022-12:08:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.0262743
[11/24/2022-12:08:32] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:32] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(723 -> <out>) (Reformat)
[11/24/2022-12:08:32] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0267558
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.041488
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0118393
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0118393
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(635712,1,7224,43) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00560404
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.043728
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00570585
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00560404
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00642385
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0436491
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0062237
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0062237
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00773125
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0437166
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00776613
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00773125
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00500256
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0116533
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0048579
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0048579
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0065546
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0218338
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00647036
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00647036
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00652551
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220421
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0063525
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0063525
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,504,3) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00671543
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220702
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00678691
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00671543
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 724) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00694618
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0219553
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00690677
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00690677
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(635712,1,7224,43) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,504,3) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0164277
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0197674
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0165034
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0164277
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0185429
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0197709
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0185474
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0185429
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0978103
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0452389
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0978629
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0452389
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0136698
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0154679
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.020088
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0136698
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0181189
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0146711
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0112447
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0112447
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183486
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0133191
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00946229
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00946229
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183034
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0131649
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.018276
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0131649
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0752503
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0204082
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0750377
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204082
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0190829
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0454
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.019476
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0190829
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0187331
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.044136
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0182177
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0182177
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.103945
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0448674
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.105358
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0448674
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0164653
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0227109
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0163093
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0163093
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.018408
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0241417
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0183777
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0183777
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183263
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0241326
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0183491
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0183263
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183474
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240549
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0182509
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0182509
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.080256
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.020544
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0799086
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.020544
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.019996
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0451154
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0192269
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0192269
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.018564
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.044048
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0185257
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0185257
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.103015
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0443017
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.103147
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0443017
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0184177
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0224248
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0184474
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0184177
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.020593
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0236251
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0205251
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0205251
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0207203
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0238659
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0206504
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0206504
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0205309
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240259
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0206694
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0205309
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0796206
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0205146
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0797051
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0205146
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0285006
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0450994
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0285783
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0285006
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0184309
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0442057
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0182451
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0182451
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0205851
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0444766
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0211468
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0205851
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.02784
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0226939
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0273265
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0226939
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0287013
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0234887
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.027869
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0234887
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0205904
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240625
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0207249
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0205904
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0205185
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240792
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0205433
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0205185
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.08664
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0208516
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0864343
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208516
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.013871
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.015419
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0192663
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.013871
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0165201
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0225065
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0162702
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0162702
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0184709
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0225084
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0183863
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0183863
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.097248
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0200543
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0972891
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0200543
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0162265
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0133103
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0112021
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0112021
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183366
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0122229
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00952869
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00952869
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0180994
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0120785
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0180703
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0120785
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0736709
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0168081
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0740686
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0168081
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0186406
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0224666
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0100355
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0100355
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183846
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0231014
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0184366
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0183846
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0206158
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0228924
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0206269
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0206158
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0979223
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0204963
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0976251
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0204963
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.016287
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0609006
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00974842
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00974842
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0204865
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240762
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00707048
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00707048
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0203646
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240579
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0204336
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0203646
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0395017
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0203634
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0394046
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0203634
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0188491
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0225051
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00769059
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00769059
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0184891
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0236264
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0184726
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0184726
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0206811
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0236891
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0208072
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0206811
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.100398
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0210756
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.100722
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0210756
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0165029
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.059011
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00680769
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00680769
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0185994
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240876
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0066774
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0066774
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.020448
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0241463
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0204565
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.020448
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0770331
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.021024
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0768983
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.021024
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0187834
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0225097
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0186154
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0186154
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183509
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.022336
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0183754
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0183509
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0210031
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0237851
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0209946
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0209946
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.100217
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0223301
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.100249
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0223301
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0168924
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0579779
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0166745
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0166745
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0190823
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0239718
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0188703
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0188703
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0202606
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240579
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.020312
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0202606
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.076928
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0211494
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0769623
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0211494
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0192097
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0224581
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0193526
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0192097
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0183857
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0242941
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0189206
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0183857
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.020657
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0235794
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.02093
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.020657
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.103744
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0238629
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.102891
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0238629
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0175782
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0582278
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0175528
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0175528
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0114873
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0241204
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0114697
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0114697
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0202646
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0241676
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0203434
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0202646
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 730) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0202269
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0240549
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0202486
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0202269
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(635712,1,7224,43) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,504,3) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(635712,1,7224,43) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,504,3) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(635712,1,7224,43) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00456414
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0115668
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00477958
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00456414
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00547708
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0435749
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00580699
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00547708
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00694923
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0435714
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00686389
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00686389
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00453486
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0113217
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00453871
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00453486
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00536076
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0219233
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00546032
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00536076
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00539682
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.02192
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00554057
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00539682
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,504,3) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00567877
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0218887
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00558101
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00558101
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 739) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00576183
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0221179
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00555903
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00555903
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(635712,1,7224,43) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:16,504,3) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,5376,32) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0303781
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0455063
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0304795
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0303781
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(118272,1:4,1344,8) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0303973
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0449554
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0307959
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0303973
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0396469
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0454103
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0399817
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0396469
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00956465
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0246103
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.009386
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.009386
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:2,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.02472
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0225626
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0246164
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0225626
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:8,672,4) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0253219
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0230916
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0253189
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0230916
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0262789
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0230393
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0264891
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0230393
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 745) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0265189
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0229159
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0264556
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1002 Time: 0.0229159
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,5376,32) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00658265
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0440491
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00670982
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00658265
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(118272,1:4,1344,8) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00687586
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0440949
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00695946
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00687586
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00947943
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0439246
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00950486
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00947943
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00514465
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0113182
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00528751
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00514465
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:2,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00693224
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0221009
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00689741
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00689741
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:8,672,4) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00701061
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220264
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00699015
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00699015
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00730606
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.021986
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00705197
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00705197
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 748) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0074464
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220121
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0072912
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0072912
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,5376,32) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.004507
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0115221
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00474382
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.004507
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(118272,1:4,1344,8) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00546963
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.043304
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00550418
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00546963
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00675429
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0434994
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0068295
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00675429
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00457829
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0110934
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00466581
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00457829
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:2,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00523869
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0219069
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00555798
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00523869
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:8,672,4) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00551473
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.022031
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00559174
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00551473
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00562673
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0218906
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00563851
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00562673
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 751) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00572873
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0219572
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00558259
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00558259
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,5376,32) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00558963
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.043712
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00553407
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00553407
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(118272,1:4,1344,8) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0063682
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0436869
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00643776
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0063682
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00777528
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0439131
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00778274
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00777528
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00489737
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0112299
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00476033
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00476033
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:2,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00642842
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220526
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00657912
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00642842
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:8,672,4) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00657912
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0221505
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00653797
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00653797
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00706634
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0221962
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00698732
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00698732
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 754) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0069649
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0222047
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00696555
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0069649
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,5376,32) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(118272,1:4,1344,8) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:2,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:8,672,4) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(473088,1,5376,32) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(118272,1:4,1344,8) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:2,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(59136,1:8,672,4) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00589861
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0438731
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00576567
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00576567
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00659782
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0435577
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00666369
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00659782
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00773269
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0436206
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00778635
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00773269
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00487909
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0112907
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0048093
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0048093
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00660218
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220454
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0066693
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00660218
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00676571
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0222393
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00650951
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00650951
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0068295
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0220317
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00687216
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0068295
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 763) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00688326
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0221904
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00689567
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00688326
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00976396
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0452949
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00984472
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00976396
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0115759
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0453314
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.011417
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011417
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0166639
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0451794
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0165684
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0165684
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00608057
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0117788
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.00632586
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.00608057
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0115116
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0223517
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.011404
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011404
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0114335
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0222838
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0114127
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0114127
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0115552
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0223824
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0116255
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 1000 Time: 0.0115552
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 766) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.0120808
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0224555
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 0 Time: 0.0119451
[11/24/2022-12:08:33] [V] [TRT] Fastest Tactic: 0 Time: 0.0119451
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(354816,1,4032,24) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(354816,14784,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(177408,14784:2,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(14784,14784:32,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:33] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:33] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1000 Time: 0.00732
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:33] [V] [TRT] Tactic: 1002 Time: 0.0453189
[11/24/2022-12:08:33] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00734697
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00732
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00776469
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0452571
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00765642
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00765642
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0114884
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0451863
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0113815
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0113815
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00691265
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0114124
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00688936
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00688936
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00760998
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0223171
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00777023
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00760998
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00765907
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0221793
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00768409
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00765907
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00770767
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0221009
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00766508
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00766508
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 772) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00773823
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0222126
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00785323
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00773823
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(310464,1,3528,21) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00669319
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.043632
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00677423
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00669319
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00695336
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0436034
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00701301
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00695336
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00933714
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.043512
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00946057
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00933714
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00515967
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0113874
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00544796
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00515967
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00712664
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0220199
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00720663
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00712664
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00718011
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0218534
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00705633
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00705633
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.007288
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0220669
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00722492
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00722492
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 775) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00746263
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0219742
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00732091
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00732091
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(310464,1,3528,21) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0058006
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0434297
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00581138
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0058006
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00669756
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.043368
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00652218
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00652218
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00779284
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0435166
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0078246
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00779284
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00485989
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0112869
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00484541
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00484541
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0066481
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.021967
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0064964
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0064964
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00671356
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.022176
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00649779
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00649779
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00682536
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0220075
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00691026
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00682536
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 778) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00688653
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0220199
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00697121
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00688653
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(310464,1,3528,21) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.004555
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0113839
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00476225
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.004555
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.005536
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0432914
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0055091
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0055091
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00683733
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0437029
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00691788
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00683733
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00449957
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0111532
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00483017
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00449957
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00548114
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.02195
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00555622
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00548114
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00557996
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0218691
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00559719
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00557996
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00569196
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0217874
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00568334
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00568334
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 781) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00590153
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0219442
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0057366
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0057366
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(310464,1,3528,21) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00556343
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.011156
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00551174
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00551174
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00710792
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0116976
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00709921
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00709921
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0974743
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0454937
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0973554
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0454937
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00506388
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0114553
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00519265
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00506388
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00585271
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.01175
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00513469
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00513469
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00961676
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0114912
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00690373
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00690373
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.015803
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0127135
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0158791
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0127135
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0743703
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0201286
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0742377
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0201286
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00512996
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.011046
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00516686
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00512996
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00726217
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.04292
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00713774
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00713774
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0974354
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0425634
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0971017
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0425634
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00497466
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0110449
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00507255
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00497466
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0058048
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0117939
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00574994
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00574994
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00961676
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0227788
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00960335
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00960335
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.015819
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0226456
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0157413
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0157413
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0738743
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0199177
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0733783
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0199177
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00557415
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0434537
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00578962
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00557415
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00559525
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0433943
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00582327
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00559525
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0962811
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0424949
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0966903
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0424949
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00566189
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0220617
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00569161
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00566189
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00593554
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0116751
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00594944
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00593554
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00962194
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0227481
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0096061
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0096061
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0157614
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0226423
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0154802
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0154802
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0739497
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0207367
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0747954
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207367
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00706373
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0442697
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00717349
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00706373
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0071824
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0442434
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00750423
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0071824
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00926029
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.042744
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00909771
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00909771
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00710727
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.022752
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00733303
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00710727
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00725074
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0126114
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00756379
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00725074
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.011827
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0235944
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0118702
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.011827
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0175817
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.023601
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0176696
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0175817
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0753257
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0207438
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0755954
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207438
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00618419
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0119299
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00600743
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00600743
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00626286
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0116076
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00637456
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00626286
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0075674
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0233143
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00752698
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00752698
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0978171
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0208633
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0980023
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208633
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00670442
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0119326
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00628611
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00628611
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00992366
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.012123
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00733143
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00733143
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.015493
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0121029
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0155282
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0121029
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0751588
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0169646
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0749714
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0169646
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00629744
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0228062
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00532978
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00532978
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00649392
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0230583
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00639245
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00639245
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00837308
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0232908
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00836038
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00836038
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0978606
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0208575
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0980114
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0208575
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0064002
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.058467
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00549468
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00549468
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0102016
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0235703
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00674722
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00674722
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0156005
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0235226
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0156233
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0156005
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0750446
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0206485
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0750309
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0206485
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0064155
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0232189
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00640338
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00640338
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00638132
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0229571
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00652384
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00638132
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00830679
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0247855
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00844746
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00830679
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0979931
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0242552
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0981851
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0242552
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00636363
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0591131
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00621219
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00621219
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00688283
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0232483
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00637893
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00637893
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0155634
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.023729
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0156992
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0155634
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0752434
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0206491
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0747909
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0206491
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00669693
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.022754
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00677299
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00669693
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00683559
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.022641
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00685888
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00683559
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00834133
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0252328
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00835987
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00834133
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0986446
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0249821
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0987657
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0249821
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00676862
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0589958
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00652842
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00652842
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00687804
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0233933
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00681469
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00681469
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0101047
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0236454
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0101611
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0101047
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0754126
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0207269
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.075232
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0207269
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00693246
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0228545
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00677839
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00677839
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,1,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00684735
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0229218
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00685845
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00684735
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00874057
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0253211
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00848269
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00848269
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0984137
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0241547
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0985463
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0241547
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00676842
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0591726
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00665787
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00665787
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00707352
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0233907
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00687565
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00687565
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0102253
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0236153
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0101257
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0101257
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 787) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0166695
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0238789
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0162606
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0162606
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(310464,1,3528,21) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00990171
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0453646
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0099901
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00990171
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0119451
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0468754
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.011965
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0119451
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0157303
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0464343
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0158318
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0157303
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00669444
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0121341
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00697796
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00669444
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.011885
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0233215
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0117771
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0117771
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.011879
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0235507
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0118298
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0118298
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.011878
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0234919
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0120907
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.011878
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 790) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.012061
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0234691
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0117032
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0117032
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(7569408,1,86016,512) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(1892352,1:4,21504,128) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(7569408,14784,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(3784704,14784:2,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(946176,1:8,10752,64) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(473088,1:16,5376,32) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(1892352,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Int8(236544,14784:32,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(310464,1,3528,21) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00907114
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0455349
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00915429
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00907114
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0095485
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0455086
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00952808
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00952808
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0128389
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0458194
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0129269
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0128389
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00660218
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0117366
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00664519
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.00660218
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00948771
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0230132
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00943171
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00943171
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00971002
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0234671
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00947857
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00947857
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:16,336,2) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.00959238
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0234103
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00957684
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00957684
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 793) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0098051
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0233476
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00971002
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00971002
[11/24/2022-12:08:34] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0186789
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0204506
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.018788
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0186789
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0145755
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0162428
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.020655
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0145755
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0181657
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0152526
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0119505
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0119505
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0198343
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0137924
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.00985813
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00985813
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0207046
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0456674
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0205656
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0205656
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.019312
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0455166
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0188183
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0188183
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0180743
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0234312
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0179646
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0179646
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0186663
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0241935
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0183251
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0183251
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0197457
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0252853
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0195583
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0195583
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0199206
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.045792
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0204532
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0199206
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0185931
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0234971
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0184749
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0184749
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0212167
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0243771
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0210945
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0210945
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0225809
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0247703
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0223974
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0223974
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.029088
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0458434
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0293211
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.029088
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0219853
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0456114
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0216131
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0216131
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0300681
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0236865
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0297618
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0236865
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0298478
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0243451
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0296302
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.0243451
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0226305
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0250057
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0221727
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0221727
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0142562
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0165526
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0205962
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0142562
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0193463
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0237159
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.019576
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 1000 Time: 0.0193463
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0178903
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0139512
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0120042
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0120042
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0181194
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0127947
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0098301
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0098301
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0185389
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0230994
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0103389
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0103389
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1000 Time: 0.0213048
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 1002 Time: 0.0237303
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:34] [V] [TRT] Tactic: 0 Time: 0.0212056
[11/24/2022-12:08:34] [V] [TRT] Fastest Tactic: 0 Time: 0.0212056
[11/24/2022-12:08:34] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:34] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:34] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0178052
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0611794
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0108562
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0108562
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0207752
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.024464
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00760156
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00760156
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0191411
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0232967
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00896143
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00896143
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0217868
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0238667
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0213355
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0213355
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0180594
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0596571
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00725966
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00725966
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0207412
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0244983
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00699755
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00699755
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0191366
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0235069
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0191794
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0191366
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0215216
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0238545
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0214622
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0214622
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0179766
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.058819
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0178062
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0178062
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0207321
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0247954
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0204362
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0204362
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0208287
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0249128
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0208209
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0208209
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0195674
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0234893
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0196326
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0195674
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0215412
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0239154
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0220108
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0215412
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.018216
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0591832
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0182097
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0182097
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0122103
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0248076
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0122255
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0122103
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(730 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0207909
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.025261
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0207608
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0207608
[11/24/2022-12:08:35] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(162624,1:4,1848,11) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 794) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0194777
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0460034
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0194097
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0194097
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(635712,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 794) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0149029
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0182789
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0135655
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0135655
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(325248,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 794) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.01826
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0232744
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0183749
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.01826
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(88704,1:8,1008,6) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(<in> -> 794) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0187617
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0238248
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.019036
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0187617
[11/24/2022-12:08:35] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00757871
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.011885
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0074448
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0074448
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00615429
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0118048
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00608381
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00608381
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00695967
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0122522
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00606114
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00606114
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00997303
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0121661
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00723451
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00723451
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00608705
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0117679
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00624457
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00608705
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00745051
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0427303
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00758232
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00745051
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00591049
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0117254
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00612114
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00591049
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00692767
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.012432
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00690395
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00690395
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0100288
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0234795
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0101294
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0100288
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00642783
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0448366
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00640576
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00640576
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00631414
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0228513
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00630619
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00630619
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0069551
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0123078
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00678816
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00678816
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0101711
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0235585
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0104431
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0101711
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00720663
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.044624
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00735063
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00720663
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00915657
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0428811
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00922143
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00915657
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00721989
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0227696
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00746286
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00721989
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00728549
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0121253
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00739543
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00728549
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.01192
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0237623
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0118365
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0118365
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00606419
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0119383
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00584174
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00584174
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00761985
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0232294
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00744069
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00744069
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00666618
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0122091
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00599295
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00599295
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0100834
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0120602
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00734857
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00734857
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00643677
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0225822
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00562883
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00562883
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00831365
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0234083
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00848215
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00831365
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00636363
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0588053
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00562725
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00562725
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.010148
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0235226
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00680337
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00680337
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00635766
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0227925
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00611905
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00611905
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00841143
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0251886
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00817422
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00817422
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00629605
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0593249
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00621873
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00621873
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00694509
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0233136
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00621295
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00621295
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00679086
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0229198
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00673912
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00673912
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00839898
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0249836
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00826464
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00826464
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00672603
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0590446
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00665995
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00665995
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00695205
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0232385
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00671356
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00671356
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0102651
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.023648
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0101586
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0101586
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00687543
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.022752
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0068086
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0068086
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00855771
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0254301
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00844827
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00844827
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00688022
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0591893
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00677423
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00677423
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00704718
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0233208
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00697012
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00697012
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: Optimizer Reformat(787 -> <out>) (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0102211
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0235063
[11/24/2022-12:08:35] [V] [TRT] Setting a default quantization params because quantization data is missing for 
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0103262
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0102211
[11/24/2022-12:08:35] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(88704,1:4,1008,6) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(310464,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(162624,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(44352,1:8,504,3) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(236544,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00909314
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.018776
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00945
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00909314
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(236544,1,2688,16) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0190731
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0456663
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0191029
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0190731
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(59136,1:4,672,4) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0197023
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.045776
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0195149
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0195149
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0289591
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.046072
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0287451
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0287451
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(236544,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00917086
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0182394
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00907771
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00907771
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(118272,14784:2,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0181457
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0233724
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0182177
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0181457
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(29568,1:8,336,2) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0193606
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.023955
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0184194
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0184194
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0182069
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.023552
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0183046
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0182069
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 730 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0200417
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0234945
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0195171
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0195171
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] =============== Computing reformatting costs
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00553969
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0117415
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00618019
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00553969
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00560105
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0120461
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00536499
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00536499
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,1:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00644631
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.044728
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00653901
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00644631
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Float(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0072208
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0449029
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00736046
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0072208
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00560949
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0118375
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00554092
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00554092
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:2,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00645366
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0229238
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0064004
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0064004
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:8,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00642862
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0228042
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00646738
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00642862
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,1:16,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00686759
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0228193
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00668467
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00668467
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning Reformat: Half(14784,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: 787 copy (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.00686585
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0226776
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.00687826
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.00686585
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination:  -> Float(473088,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination:  -> Half(473088,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0228473
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.0326601
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.013573
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.013573
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0777051
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.100617
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0820251
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0777051
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.125904
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.124514
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.119968
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.119968
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.229029
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.101694
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.214254
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.101694
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.408576
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.126251
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.425874
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.126251
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,1,1344,2) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0278888
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.582437
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0269272
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.0269272
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,1,1344,2) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.075888
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.557637
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0810217
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.075888
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,1,1344,2) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.12048
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.554062
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.122898
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.12048
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,1,1344,2) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.2128
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.55259
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.21701
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.2128
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(473088,1,1344,2) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.438981
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 4.05538
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.446213
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.438981
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,1:4,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0646095
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.585801
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.0667931
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.0646095
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,1:4,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.127707
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.572
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.121957
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.121957
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,1:4,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.167685
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.577426
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.170487
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.167685
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,1:4,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.274025
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.568206
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.279237
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.274025
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,1:4,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.508782
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 4.06544
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.349806
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.349806
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.110537
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.582839
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.110398
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.110398
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.119534
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.561531
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.11965
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 1000 Time: 0.119534
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.165696
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.561646
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.165079
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.165079
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,236544:32,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.214432
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 0.560681
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.211502
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.211502
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.423794
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 4.05875
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.416014
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.416014
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(1:4,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.0564861
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 1.14462
[11/24/2022-12:08:35] [V] [TRT] Tactic: 0 Time: 0.056291
[11/24/2022-12:08:35] [V] [TRT] Fastest Tactic: 0 Time: 0.056291
[11/24/2022-12:08:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:35] [V] [TRT] *************** Autotuning format combination: Float(1:4,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:35] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:35] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1000 Time: 0.114517
[11/24/2022-12:08:35] [V] [TRT] Tactic: 1002 Time: 3.9561
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.113822
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.113822
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Float(1:4,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.147625
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 3.95496
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.149989
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.147625
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Float(1:4,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.253838
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 3.96084
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.275346
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.253838
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Float(1:4,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.308233
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 1.14593
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.30816
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.30816
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(473088,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0227226
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.0328247
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0228722
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.0227226
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(473088,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.062979
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.271214
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.06352
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.062979
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(473088,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0948137
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.272553
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0702888
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0702888
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(473088,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.157243
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.269472
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.166825
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.157243
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(473088,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.298587
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.552841
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.290697
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.290697
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:2,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0315072
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.268599
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0312695
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0312695
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:2,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0445211
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.275986
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0472937
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.0445211
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:2,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0720526
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.27648
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0734446
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.0720526
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:2,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.122569
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.275872
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.156681
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.122569
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:2,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.276197
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 8.34171
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.282345
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.276197
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0426091
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.273321
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.053059
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.0426091
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.094096
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.287584
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0934491
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0934491
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.12139
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.284027
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.122969
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.12139
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.203259
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.311534
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.210885
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.203259
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.365047
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 8.34913
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.366848
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.365047
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:16,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0961303
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.273815
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0952503
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0952503
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:16,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.112229
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.287067
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.113323
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.112229
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:16,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.147333
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.283045
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.148142
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.147333
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:16,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.239506
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.311406
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.246322
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.239506
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,1:16,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.427063
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 8.35194
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.409728
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.409728
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.141159
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.273705
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.14144
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.141159
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.133847
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.292119
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.133877
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.133847
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.172535
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.283351
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.171954
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.171954
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:32,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.267867
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.315218
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.268274
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.267867
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.455968
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 8.35647
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.444786
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.444786
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(1:8,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.0567726
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 0.535474
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.0564343
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0564343
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(1:8,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.113934
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 8.30522
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.114672
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.113934
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(1:8,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1000 Time: 0.145531
[11/24/2022-12:08:36] [V] [TRT] Tactic: 1002 Time: 8.31636
[11/24/2022-12:08:36] [V] [TRT] Tactic: 0 Time: 0.207502
[11/24/2022-12:08:36] [V] [TRT] Fastest Tactic: 1000 Time: 0.145531
[11/24/2022-12:08:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:36] [V] [TRT] *************** Autotuning format combination: Half(1:8,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:36] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:36] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.267017
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 8.3223
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.275625
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.267017
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Half(1:8,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.312919
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.602706
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.304507
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.304507
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Half(473088:32,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.208777
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.540494
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.208887
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.208777
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Half(473088:32,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.311867
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 8.32871
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.289723
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.289723
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Half(473088:32,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.347845
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 8.33465
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.347749
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.347749
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Half(473088:32,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.38283
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 8.33186
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.386341
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.38283
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Half(473088:32,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.453545
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.610249
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.444951
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.444951
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:4,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.0353829
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.455145
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.0354789
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.0353829
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:4,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.0640305
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.0633798
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.061792
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.061792
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:4,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.0991314
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.323346
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.0973051
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.0973051
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:4,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.188782
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.266853
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.205134
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.188782
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:4,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.378021
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.378021
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.143113
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.463977
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.151886
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.143113
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.14901
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.252288
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.113072
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.113072
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.148105
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.324165
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.148128
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.148105
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.245627
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.274839
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.234848
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 0 Time: 0.234848
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.406048
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.406048
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(473088:32,236544,672,1) -> Float(1182720,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.0967314
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.0967314
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(473088:32,236544,672,1) -> Float(1182720,1,3360,5) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.155744
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.155744
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(473088:32,236544,672,1) -> Float(473088,1:4,1344,2) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.190267
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.190267
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(473088:32,236544,672,1) -> Float(236544,236544:32,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.235913
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.235913
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Int8(473088:32,236544,672,1) -> Float(1:4,236544,672,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Cast)
[11/24/2022-12:08:37] [V] [TRT] Cast has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_509 (Reformat)
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1000 Time: 0.25632
[11/24/2022-12:08:37] [V] [TRT] Tactic: 1002 Time: 0.523067
[11/24/2022-12:08:37] [V] [TRT] Tactic: 0 Time: 0.256562
[11/24/2022-12:08:37] [V] [TRT] Fastest Tactic: 1000 Time: 0.25632
[11/24/2022-12:08:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1000
[11/24/2022-12:08:37] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:37] [V] [TRT] *************** Autotuning format combination: Float(1182720,236544,672,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudaDepthwiseConvolution)
[11/24/2022-12:08:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:37] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (FusedConvActConvolution)
[11/24/2022-12:08:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:38] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudnnConvolution)
[11/24/2022-12:08:43] [V] [TRT] Tactic: 0 Time: 1.14411
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1 Time: 0.435589
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2 Time: 2.86624
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5 Time: 8.21602
[11/24/2022-12:08:43] [V] [TRT] Tactic: 56 Time: 0.559881
[11/24/2022-12:08:43] [V] [TRT] Tactic: 57 Time: 0.879461
[11/24/2022-12:08:43] [V] [TRT] Tactic: 58 Time: 0.704192
[11/24/2022-12:08:43] [V] [TRT] Tactic: 61 Time: 8.48576
[11/24/2022-12:08:43] [V] [TRT] Tactic: 112 Time: 0.475959
[11/24/2022-12:08:43] [V] [TRT] Tactic: 113 Time: 0.489504
[11/24/2022-12:08:43] [V] [TRT] Tactic: 114 Time: 0.87643
[11/24/2022-12:08:43] [V] [TRT] Tactic: 117 Time: 6.78856
[11/24/2022-12:08:43] [V] [TRT] Fastest Tactic: 1 Time: 0.435589
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:08:43] [V] [TRT] Tactic: 130477820174479366 Time: 0.491351
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1358952225285826925 Time: 0.279607
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4549827808004681195 Time: 0.192923
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5127140674766136213 Time: 0.267904
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5691674214365884252 Time: 0.479095
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5779835512569528575 Time: 0.361883
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:08:43] [V] [TRT] Tactic: 6053873026024413720 Time: 0.497454
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:08:43] [V] [TRT] Tactic: 6532229230713743445 Time: 0.49568
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:08:43] [V] [TRT] Tactic: 6767548733843469815 Time: 0.226162
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:08:43] [V] [TRT] Tactic: -6693149634808211969 Time: 0.26949
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:08:43] [V] [TRT] Tactic: -6313876406580483184 Time: 0.147479
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:08:43] [V] [TRT] Tactic: -4932505327461806800 Time: 0.489353
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:08:43] [V] [TRT] Tactic: -2870780723387717246 Time: 0.318642
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:08:43] [V] [TRT] Tactic: -1123676555321336786 Time: 0.362395
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:08:43] [V] [TRT] Tactic: -701551393537224327 Time: 0.195026
[11/24/2022-12:08:43] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 0.147479
[11/24/2022-12:08:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6313876406580483184
[11/24/2022-12:08:43] [V] [TRT] *************** Autotuning format combination: Float(1182720,1,3360,5) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1852818056038333088 Time: 0.29008
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2137271960938803767 Time: 0.274592
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4543151729465212056 Time: 1.19206
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5778138195697110003 Time: 0.399118
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7098622778606028509 Time: 0.269029
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:08:43] [V] [TRT] Tactic: -9217704540809507511 Time: 0.305298
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:08:43] [V] [TRT] Tactic: -7734972403155710907 Time: 0.261509
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[11/24/2022-12:08:43] [V] [TRT] Tactic: -3855385237722507464 Time: 0.406171
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:08:43] [V] [TRT] Tactic: -3360299822783115645 Time: 0.478464
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:08:43] [V] [TRT] Tactic: -2809379259463049391 Time: 0.403008
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:08:43] [V] [TRT] Tactic: -824800713406371346 Time: 0.265161
[11/24/2022-12:08:43] [V] [TRT] Fastest Tactic: -7734972403155710907 Time: 0.261509
[11/24/2022-12:08:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7734972403155710907
[11/24/2022-12:08:43] [V] [TRT] *************** Autotuning format combination: Float(473088,1:4,1344,2) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 1237784342446422381
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1237784342446422381 Time: 0.596905
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 1426562292875733922
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1426562292875733922 Time: 0.332361
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1852818056038333088 Time: 0.291794
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2137271960938803767 Time: 0.284325
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 2388153022056233219
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2388153022056233219 Time: 0.365029
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 2716437853123234317
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2716437853123234317 Time: 0.425143
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2860655430572478466 Time: 0.429513
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 3278852197192504305
[11/24/2022-12:08:43] [V] [TRT] Tactic: 3278852197192504305 Time: 0.597463
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 3904690393614050557
[11/24/2022-12:08:43] [V] [TRT] Tactic: 3904690393614050557 Time: 0.413637
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 4061115162338989075
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4061115162338989075 Time: 0.646839
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4474630279712975759 Time: 0.450642
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4479823862704990365 Time: 0.447511
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4543151729465212056 Time: 1.22669
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:08:43] [V] [TRT] Tactic: 4696204239951173149 Time: 0.435141
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 5200329514761435342
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5200329514761435342 Time: 0.659351
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5778138195697110003 Time: 0.393042
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 7011693366046809027
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7011693366046809027 Time: 0.652224
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7098622778606028509 Time: 0.273262
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7155825427510256858 Time: 0.389111
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7342025736444949634 Time: 0.243758
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7347365539922924600
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7347365539922924600 Time: 0.562729
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7428197830878119671
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7428197830878119671 Time: 0.327918
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 7465323447915168822
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7465323447915168822 Time: 0.476581
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7938223790021272801
[11/24/2022-12:08:43] [V] [TRT] Tactic: 7938223790021272801 Time: 0.501682
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 8836645772682419994
[11/24/2022-12:08:43] [V] [TRT] Tactic: 8836645772682419994 Time: 0.316617
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:08:43] [V] [TRT] Tactic: 8918020581761223752 Time: 0.383963
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:08:43] [V] [TRT] Tactic: -9217704540809507511 Time: 0.320457
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -9114138070928278731
[11/24/2022-12:08:43] [V] [TRT] Tactic: -9114138070928278731 Time: 0.637385
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:08:43] [V] [TRT] Tactic: -7734972403155710907 Time: 0.265998
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: -7382359095196034537
[11/24/2022-12:08:43] [V] [TRT] Tactic: -7382359095196034537 Time: 0.679003
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[11/24/2022-12:08:43] [V] [TRT] Tactic: -7377458734869418330 Time: 0.224526
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -6223854811627385844
[11/24/2022-12:08:43] [V] [TRT] Tactic: -6223854811627385844 Time: 0.266482
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[11/24/2022-12:08:43] [V] [TRT] Tactic: -5457304872213719461 Time: 0.233006
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5441054706931585554
[11/24/2022-12:08:43] [V] [TRT] Tactic: -5441054706931585554 Time: 0.500718
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: -5043603702497465467
[11/24/2022-12:08:43] [V] [TRT] Tactic: -5043603702497465467 Time: 0.280754
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[11/24/2022-12:08:43] [V] [TRT] Tactic: -4756382386362004279 Time: 0.4328
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: -4564655677311401797
[11/24/2022-12:08:43] [V] [TRT] Tactic: -4564655677311401797 Time: 0.495017
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[11/24/2022-12:08:43] [V] [TRT] Tactic: -3855385237722507464 Time: 0.401079
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: -3540975627865078064
[11/24/2022-12:08:43] [V] [TRT] Tactic: -3540975627865078064 Time: 0.275305
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:08:43] [V] [TRT] Tactic: -3360299822783115645 Time: 0.482053
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -3151804561246216835
[11/24/2022-12:08:43] [V] [TRT] Tactic: -3151804561246216835 Time: 0.533687
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: -2885165284206163001
[11/24/2022-12:08:43] [V] [TRT] Tactic: -2885165284206163001 Time: 0.548178
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:08:43] [V] [TRT] Tactic: -2809379259463049391 Time: 0.396224
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -2801041895330778813
[11/24/2022-12:08:43] [V] [TRT] Tactic: -2801041895330778813 Time: 0.415488
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: -1758690179295738332
[11/24/2022-12:08:43] [V] [TRT] Tactic: -1758690179295738332 Time: 0.387031
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -1484546572846226796
[11/24/2022-12:08:43] [V] [TRT] Tactic: -1484546572846226796 Time: 0.476832
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -858667497925695276
[11/24/2022-12:08:43] [V] [TRT] Tactic: -858667497925695276 Time: 0.555931
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:08:43] [V] [TRT] Tactic: -824800713406371346 Time: 0.280608
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:08:43] [V] [TRT] Tactic: -504296718212024303 Time: 0.385883
[11/24/2022-12:08:43] [V] [TRT] Fastest Tactic: -7377458734869418330 Time: 0.224526
[11/24/2022-12:08:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7377458734869418330
[11/24/2022-12:08:43] [V] [TRT] *************** Autotuning format combination: Half(1182720,236544,672,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudnnConvolution)
[11/24/2022-12:08:43] [V] [TRT] Tactic: 0 Time: 0.29088
[11/24/2022-12:08:43] [V] [TRT] Tactic: 1 Time: 0.273929
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2 Time: 0.565751
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5 Time: 6.57439
[11/24/2022-12:08:43] [V] [TRT] Tactic: 56 Time: 0.310405
[11/24/2022-12:08:43] [V] [TRT] Tactic: 58 Time: 0.585088
[11/24/2022-12:08:43] [V] [TRT] Tactic: 61 Time: 6.58664
[11/24/2022-12:08:43] [V] [TRT] Fastest Tactic: 1 Time: 0.273929
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:08:43] [V] [TRT] *************** Autotuning format combination: Half(709632,236544:2,672,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (FusedConvActConvolution)
[11/24/2022-12:08:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:43] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:08:43] [V] [TRT] Tactic: 2195670545862694453 Time: 0.100311
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[11/24/2022-12:08:43] [V] [TRT] Tactic: 3419182076704469245 Time: 0.134263
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:08:43] [V] [TRT] Tactic: 3891805945559659536 Time: 0.378423
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:08:43] [V] [TRT] Tactic: 5548126322150286555 Time: 0.133623
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:08:43] [V] [TRT] Tactic: 6057304366605292508 Time: 0.131104
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[11/24/2022-12:08:43] [V] [TRT] Tactic: -7928611605886347652 Time: 0.384416
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[11/24/2022-12:08:43] [V] [TRT] Tactic: -5172391392092686714 Time: 0.103127
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:08:43] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0961189
[11/24/2022-12:08:43] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:08:43] [V] [TRT] Tactic: -1546027692247304867 Time: 0.378094
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: -4374269919094467161 Time: 0.0961189
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4374269919094467161
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,672,1) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudaDepthwiseConvolution)
[11/24/2022-12:08:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:08:44] [V] [TRT] Tactic: 254850674756030979 Time: 0.348594
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[11/24/2022-12:08:44] [V] [TRT] Tactic: 328038211831149625 Time: 0.21248
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[11/24/2022-12:08:44] [V] [TRT] Tactic: 411553864378931917 Time: 0.180983
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 605415215044822950
[11/24/2022-12:08:44] [V] [TRT] Tactic: 605415215044822950 Time: 0.121355
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1011057357468998345 Time: 0.181998
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1016009564074305832 Time: 0.331419
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1156328698016730421 Time: 0.391579
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 1236070762725864170
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1236070762725864170 Time: 0.0860297
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 1297835561412423383
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1297835561412423383 Time: 0.0899177
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 1484051751570462061
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1484051751570462061 Time: 0.104085
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 1710761387006445904
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1710761387006445904 Time: 0.109463
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1723736032573714698 Time: 0.211863
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 1788275858806332606
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1788275858806332606 Time: 0.0751474
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1832046141070096030 Time: 0.290944
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1838082074606840426 Time: 0.187899
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 1876080869840372148
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1876080869840372148 Time: 0.08064
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1899296423087490472 Time: 0.289595
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 2014386895388196995
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2014386895388196995 Time: 0.0712808
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 2285052789339973171
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2285052789339973171 Time: 0.0884251
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2428167804343994714 Time: 0.203223
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2541579301352125276 Time: 0.292
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 2618052373734885647
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2618052373734885647 Time: 0.170222
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2657157263811141609 Time: 0.426437
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 2754576449974188611
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2754576449974188611 Time: 0.187858
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2819719497590964443 Time: 0.560722
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 2885411890874123330
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2885411890874123330 Time: 0.0727566
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2968605903460894194 Time: 0.192178
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2986078304285316765 Time: 0.29264
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 3014367713063089410
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3014367713063089410 Time: 0.0785646
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16 Tactic: 3016308193087082166
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3016308193087082166 Time: 0.727205
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 3094146840800930111
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3094146840800930111 Time: 0.0862674
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 3111630609330706559
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3111630609330706559 Time: 0.0758789
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 3221382575080507859
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3221382575080507859 Time: 0.224713
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 3293261797412283333
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3293261797412283333 Time: 0.0766971
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 3355662717192093688
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3355662717192093688 Time: 0.0834194
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3362537467505018070 Time: 0.390514
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3513075359009385578 Time: 0.414798
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 3524252352629695977
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3524252352629695977 Time: 0.246574
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3573559043797674382 Time: 0.294446
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3591970081995419777 Time: 0.236375
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3704534001553878387 Time: 0.378066
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 3821081349796384238
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3821081349796384238 Time: 0.118949
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 3900825777106964947
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3900825777106964947 Time: 0.118512
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4278315135102886928 Time: 0.50384
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4503233883285355107 Time: 0.103083
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4540505769798915372 Time: 0.223589
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4802447371470387646 Time: 0.257166
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5059676457552313631 Time: 0.345728
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5368829646735632944 Time: 0.262729
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5398999388616959893 Time: 0.282514
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5746691132547383910 Time: 0.337321
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5770170567977052602 Time: 0.188256
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5953552212833506549 Time: 0.123426
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 6006391580592745401
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6006391580592745401 Time: 0.185243
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6034364043891107501 Time: 0.333477
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6074229447555668232 Time: 0.292329
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6154447660803990543 Time: 0.176649
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6325769668000961702 Time: 0.367762
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6350273239113254096 Time: 0.211557
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 6373920594237855975
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6373920594237855975 Time: 0.172544
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6377497238381488891 Time: 0.373925
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6446388116965632819 Time: 0.191186
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6468794451065529747 Time: 0.28144
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6509152032538119080
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6509152032538119080 Time: 0.326903
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 6580047526417007834
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6580047526417007834 Time: 0.162793
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6642277870194067185 Time: 0.405801
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16 Tactic: 6703181542003057635
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6703181542003057635 Time: 0.702299
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6859477213531075460 Time: 0.293591
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6972489290272968208 Time: 0.163465
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6979044990896381511 Time: 0.201993
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7216571380637776659 Time: 0.149733
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7609923741161019135 Time: 0.193303
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 7671477676541500689
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7671477676541500689 Time: 0.173193
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7705739241028240201 Time: 0.4296
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8072087735545283117 Time: 0.362725
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8101703987960976805 Time: 0.277143
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8170606396342855895 Time: 0.272677
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 8270193703352283962
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8270193703352283962 Time: 0.0653988
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 8609386743006631101
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8609386743006631101 Time: 0.0600457
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 8612200391988441496
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8612200391988441496 Time: 0.0685547
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8839784824303350101 Time: 0.139387
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[11/24/2022-12:08:44] [V] [TRT] Tactic: -9217371357561775773 Time: 0.278853
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:08:44] [V] [TRT] Tactic: -9009272790678027912 Time: 0.256123
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8985224497679592364 Time: 0.0945417
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8949544755481315679 Time: 0.181458
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -8867999442759527766
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8867999442759527766 Time: 0.207141
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8759929675070720385 Time: 0.351118
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8604374562669615024 Time: 0.421824
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -8362347876645295759
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8362347876645295759 Time: 0.317669
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -8006601114930636709
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8006601114930636709 Time: 0.086672
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: trt_turing_cutlass_image_network_first_layer_hmma_fprop_f16f16f32_nhwc_nhwc_k32r3s3c8_stride2x2 Tactic: -7952471867167523338
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7952471867167523338 Time: 0.0582888
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -7798149971944012698
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7798149971944012698 Time: 0.085632
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -7757610000269494813
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7757610000269494813 Time: 0.324553
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -7683747554614165540
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7683747554614165540 Time: 0.0769234
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -7604212447063563295
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7604212447063563295 Time: 0.0682987
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -7528383910611180842
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7528383910611180842 Time: 0.0522606
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -7428355835493435592
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7428355835493435592 Time: 0.102965
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -7109456194156851009
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7109456194156851009 Time: 0.0768297
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6917689122519989488
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6917689122519989488 Time: 0.205445
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6902925267326201166 Time: 0.196114
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6840588038605932325 Time: 0.501317
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6799856376604253964 Time: 0.3656
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -6789949785717718640
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6789949785717718640 Time: 0.0704152
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6625722781282978136 Time: 0.0931977
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -6594872535430699497
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6594872535430699497 Time: 0.0556236
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6525498856028268801 Time: 0.106121
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -6510960431881136297
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6510960431881136297 Time: 0.0734537
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6356316196810535311 Time: 0.439954
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6324345858751792783 Time: 0.0965989
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6262400699544994312 Time: 0.362834
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6257787336162086472 Time: 0.384654
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6063766379489217211 Time: 0.272928
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5777580938094193096 Time: 0.215333
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5657273398217409378 Time: 0.198821
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5530886555766748586 Time: 0.27877
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5422685219138380548 Time: 0.122832
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5261787675443473128 Time: 0.208384
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5161596964442251102 Time: 0.325152
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5127240325355316006 Time: 0.32923
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5109582882231362997 Time: 0.323369
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -5082750115275722821
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5082750115275722821 Time: 0.0979154
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4825567853927730435 Time: 0.129726
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4796511246675321840 Time: 0.526144
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4706569565442112734 Time: 0.444293
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4566599693570369588 Time: 0.359547
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4409144516525410768 Time: 0.375913
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4379519430184503304 Time: 0.190267
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4152066959007262150 Time: 0.381294
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4021926646879732549 Time: 0.493993
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3987638434926559037 Time: 0.528123
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3905653247016903130 Time: 0.286363
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3903974568488493144 Time: 0.129099
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3895429239811098010 Time: 0.330025
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3864869056275745423 Time: 0.173445
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3601464762214218301 Time: 0.29008
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3412636942650049698 Time: 0.288901
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3338665856053412950 Time: 0.109335
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -3243541398692466074
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3243541398692466074 Time: 0.332535
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -3168858964887995726
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3168858964887995726 Time: 0.158053
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3058330359340425555 Time: 0.321586
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -2899647483672319239
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2899647483672319239 Time: 0.690208
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2816084650627734155 Time: 0.25904
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2662892962457732243 Time: 0.213897
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -2590123377344686639
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2590123377344686639 Time: 0.179438
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2559894581585337900 Time: 0.333554
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2530740716768816092 Time: 0.0983909
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -2365592821493052948
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2365592821493052948 Time: 0.19056
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2332828394978346992 Time: 0.165065
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2241736083352441442 Time: 0.150139
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2161909437867201546 Time: 0.214533
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1985778916402815946 Time: 0.180402
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -1935873158869965959
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1935873158869965959 Time: 0.186016
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -1871293198177288380
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1871293198177288380 Time: 0.181106
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -1502788097503482299
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1502788097503482299 Time: 0.21051
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1500496213132463076 Time: 0.288206
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1099247066487349374 Time: 0.400695
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[11/24/2022-12:08:44] [V] [TRT] Tactic: -910286698936744682 Time: 0.252055
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[11/24/2022-12:08:44] [V] [TRT] Tactic: -606726295133751039 Time: 0.0964
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -563413451241559339
[11/24/2022-12:08:44] [V] [TRT] Tactic: -563413451241559339 Time: 0.0747863
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: -517813403956506640
[11/24/2022-12:08:44] [V] [TRT] Tactic: -517813403956506640 Time: 0.081536
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -356933163344202008
[11/24/2022-12:08:44] [V] [TRT] Tactic: -356933163344202008 Time: 0.0602331
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: -291069119579384883
[11/24/2022-12:08:44] [V] [TRT] Tactic: -291069119579384883 Time: 0.0684952
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -175265966321316526
[11/24/2022-12:08:44] [V] [TRT] Tactic: -175265966321316526 Time: 0.0746834
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -93196984589102737
[11/24/2022-12:08:44] [V] [TRT] Tactic: -93196984589102737 Time: 0.0624396
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: -7528383910611180842 Time: 0.0522606
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7528383910611180842
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Half(236544,1:16,672,1) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Half(236544,236544:32,672,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Int8(473088,236544:4,672,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudaDepthwiseConvolution)
[11/24/2022-12:08:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 1332468635798226953
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1332468635798226953 Time: 0.404955
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1508480131241957639 Time: 0.24624
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 1947019689364377201
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1947019689364377201 Time: 0.15499
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3239257003214966313 Time: 0.248425
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0937691
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7621465827583909090 Time: 0.126075
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5576936487443445631 Time: 0.12845
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2297737319934264721 Time: 0.08288
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0949783
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:08:44] [V] [TRT] Tactic: -108011214168778087 Time: 0.0825097
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0825097
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Int8(473088,236544:4,672,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudaDepthwiseConvolution)
[11/24/2022-12:08:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (FusedConvActConvolution)
[11/24/2022-12:08:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:08:44] [V] [TRT] Tactic: 175853789719975416 Time: 0.0563642
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2171150287007712632 Time: 0.06704
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0948754
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0983749
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0514712
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0603931
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6585664687867083638 Time: 0.189321
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: -3730012925709297561
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3730012925709297561 Time: 0.104722
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: -2277259417488004546
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2277259417488004546 Time: 0.30469
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:08:44] [V] [TRT] Tactic: -683636008127039856 Time: 0.185947
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: -8626990807754934295 Time: 0.0514712
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8626990807754934295
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Int8(473088,236544:4,672,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 Tactic: 984309058095623735
[11/24/2022-12:08:44] [V] [TRT] Tactic: 984309058095623735 Time: 0.107193
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0519055
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 Tactic: 3238312825609165543
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3238312825609165543 Time: 0.288649
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0952137
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4325765560739862899 Time: 0.179909
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4255737803793506479 Time: 0.177403
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0606491
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0656168
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0574872
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:08:44] [V] [TRT] Tactic: -868495160148524802 Time: 0.0930766
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: 1100922622480907544 Time: 0.0519055
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1100922622480907544
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4_nchw Tactic: 1083238733416584316
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1083238733416584316 Time: 0.125495
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4_nchw Tactic: 7376107914735551821
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7376107914735551821 Time: 0.115833
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4_nchw Tactic: -49960371584465908
[11/24/2022-12:08:44] [V] [TRT] Tactic: -49960371584465908 Time: 0.124855
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: 7376107914735551821 Time: 0.115833
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7376107914735551821
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Float(59136,59136:32,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 1011019097971850911
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1011019097971850911 Time: 0.113104
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 1071114551801767124
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1071114551801767124 Time: 0.163653
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 2623576043214044314
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2623576043214044314 Time: 0.161504
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 3281631721811475881
[11/24/2022-12:08:44] [V] [TRT] Tactic: 3281631721811475881 Time: 0.121406
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 4551754795416974366
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4551754795416974366 Time: 0.111968
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 4925112190271421402
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4925112190271421402 Time: 0.123465
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5012796702462679112 Time: 0.252457
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 5041593333398049019
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5041593333398049019 Time: 0.151785
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 5166018662410176512
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5166018662410176512 Time: 0.166112
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 6191867932654611882
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6191867932654611882 Time: 0.122096
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6556170942941957134 Time: 0.207429
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 6852868042694587230
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6852868042694587230 Time: 0.13176
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 7603959388016355182
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7603959388016355182 Time: 0.14085
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 8399092794516815300
[11/24/2022-12:08:44] [V] [TRT] Tactic: 8399092794516815300 Time: 0.26613
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -9132922677633967263
[11/24/2022-12:08:44] [V] [TRT] Tactic: -9132922677633967263 Time: 0.179886
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7988637803896331454 Time: 0.201984
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 Tactic: -7865001268126363229
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7865001268126363229 Time: 0.158258
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7606074703023778034 Time: 0.150176
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: -7413564913826321357
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7413564913826321357 Time: 0.116162
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7282232519526877434 Time: 0.249591
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: -6705478269695173396
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6705478269695173396 Time: 0.133632
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -5942379529065248478
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5942379529065248478 Time: 0.112192
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5603587790314027122 Time: 0.146789
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: -5334776871777565833
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5334776871777565833 Time: 0.162597
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: -5157868397078537095
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5157868397078537095 Time: 0.130078
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -5100834417027499764
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5100834417027499764 Time: 0.107175
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -3365360067423513506
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3365360067423513506 Time: 0.120153
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -2585288983596291193
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2585288983596291193 Time: 0.113081
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 Tactic: -2194148180068068313
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2194148180068068313 Time: 0.259296
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -1782593837177056527
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1782593837177056527 Time: 0.119314
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1610768292520086910 Time: 0.159479
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: -1573035963956198975
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1573035963956198975 Time: 0.251895
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 Tactic: -1558762241666006941
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1558762241666006941 Time: 0.210299
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 Tactic: -1365353082499976145
[11/24/2022-12:08:44] [V] [TRT] Tactic: -1365353082499976145 Time: 0.154647
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:08:44] [V] [TRT] Tactic: -621838502160440068 Time: 0.159438
[11/24/2022-12:08:44] [V] [TRT] Fastest Tactic: -5100834417027499764 Time: 0.107175
[11/24/2022-12:08:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5100834417027499764
[11/24/2022-12:08:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:44] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:08:44] [V] [TRT] Tactic: 424230345342282109 Time: 0.135799
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 Tactic: 1382943425417484710
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1382943425417484710 Time: 0.252686
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 Tactic: 1793500908545723874
[11/24/2022-12:08:44] [V] [TRT] Tactic: 1793500908545723874 Time: 0.204704
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2327398338581585326 Time: 0.19696
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 2760006678121069075
[11/24/2022-12:08:44] [V] [TRT] Tactic: 2760006678121069075 Time: 0.108199
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 4167221735570463707
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4167221735570463707 Time: 0.0967589
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4472476544237636929
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4472476544237636929 Time: 0.182834
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4549109251242445288 Time: 0.246898
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 4698357802839444845
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4698357802839444845 Time: 0.10664
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4891894697406912893
[11/24/2022-12:08:44] [V] [TRT] Tactic: 4891894697406912893 Time: 0.129467
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 5020064464968349253
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5020064464968349253 Time: 0.257006
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 5656242925971916403
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5656242925971916403 Time: 0.157394
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 5884259471515203209
[11/24/2022-12:08:44] [V] [TRT] Tactic: 5884259471515203209 Time: 0.114619
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 6346362250001597649
[11/24/2022-12:08:44] [V] [TRT] Tactic: 6346362250001597649 Time: 0.114199
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7178538052023824067 Time: 0.19115
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:08:44] [V] [TRT] Tactic: 7515859573761964679 Time: 0.242958
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 Tactic: -8539208697831798967
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8539208697831798967 Time: 0.132057
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: -8140396860606875456
[11/24/2022-12:08:44] [V] [TRT] Tactic: -8140396860606875456 Time: 0.270011
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:08:44] [V] [TRT] Tactic: -7272221766465547628 Time: 0.134926
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:08:44] [V] [TRT] Tactic: -6733478368603461850 Time: 0.126594
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -5986750462116019981
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5986750462116019981 Time: 0.116702
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -5951380861215432834
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5951380861215432834 Time: 0.118789
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -5212619216958109577
[11/24/2022-12:08:44] [V] [TRT] Tactic: -5212619216958109577 Time: 0.129936
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -4245321710353452500
[11/24/2022-12:08:44] [V] [TRT] Tactic: -4245321710353452500 Time: 0.148887
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -3685182686910560333
[11/24/2022-12:08:44] [V] [TRT] Tactic: -3685182686910560333 Time: 0.155653
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -2911474341550239945
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2911474341550239945 Time: 0.103735
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 Tactic: -2274492545683590731
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2274492545683590731 Time: 0.134409
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -2132775718427811685
[11/24/2022-12:08:44] [V] [TRT] Tactic: -2132775718427811685 Time: 0.165367
[11/24/2022-12:08:44] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -2108711254262400304
[11/24/2022-12:08:45] [V] [TRT] Tactic: -2108711254262400304 Time: 0.0970354
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1715646389905866876
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1715646389905866876 Time: 0.15061
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1008204680238783384 Time: 0.126096
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -401874538028639698
[11/24/2022-12:08:45] [V] [TRT] Tactic: -401874538028639698 Time: 0.123653
[11/24/2022-12:08:45] [V] [TRT] Fastest Tactic: 4167221735570463707 Time: 0.0967589
[11/24/2022-12:08:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4167221735570463707
[11/24/2022-12:08:45] [V] [TRT] *************** Autotuning format combination: Int8(236544,236544:32,672,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:45] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudaGroupConvolution)
[11/24/2022-12:08:45] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:45] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CudaDepthwiseConvolution)
[11/24/2022-12:08:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:45] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (FusedConvActConvolution)
[11/24/2022-12:08:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:45] [V] [TRT] --------------- Timing Runner: node_of_511 + node_of_512 + PWN(node_of_513) (CaskConvolution)
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 184229963126259101
[11/24/2022-12:08:45] [V] [TRT] Tactic: 184229963126259101 Time: 0.130574
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32 Tactic: 328135613486708155
[11/24/2022-12:08:45] [V] [TRT] Tactic: 328135613486708155 Time: 0.197481
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32 Tactic: 1111159740952609683
[11/24/2022-12:08:45] [V] [TRT] Tactic: 1111159740952609683 Time: 0.229047
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: 1134860903395928905
[11/24/2022-12:08:45] [V] [TRT] Tactic: 1134860903395928905 Time: 0.133065
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: 1276591930377039442
[11/24/2022-12:08:45] [V] [TRT] Tactic: 1276591930377039442 Time: 0.137323
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32 Tactic: 1399501420456320585
[11/24/2022-12:08:45] [V] [TRT] Tactic: 1399501420456320585 Time: 0.176553
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 1853122447892949466
[11/24/2022-12:08:45] [V] [TRT] Tactic: 1853122447892949466 Time: 0.160183
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 2325023763229477890
[11/24/2022-12:08:45] [V] [TRT] Tactic: 2325023763229477890 Time: 0.102875
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32 Tactic: 2783960536172159663
[11/24/2022-12:08:45] [V] [TRT] Tactic: 2783960536172159663 Time: 0.0882766
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32 Tactic: 2821711838552913693
[11/24/2022-12:08:45] [V] [TRT] Tactic: 2821711838552913693 Time: 0.13688
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 3401614690060226673
[11/24/2022-12:08:45] [V] [TRT] Tactic: 3401614690060226673 Time: 0.0933806
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32 Tactic: 3456719996792527006
[11/24/2022-12:08:45] [V] [TRT] Tactic: 3456719996792527006 Time: 0.111961
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4042202769383439184
[11/24/2022-12:08:45] [V] [TRT] Tactic: 4042202769383439184 Time: 0.18235
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 4734519122557206480
[11/24/2022-12:08:45] [V] [TRT] Tactic: 4734519122557206480 Time: 0.268498
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4922297020351187339
[11/24/2022-12:08:45] [V] [TRT] Tactic: 4922297020351187339 Time: 0.204517
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 5136656982162849059
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5136656982162849059 Time: 0.112885
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 5189825015507701541
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5189825015507701541 Time: 0.194528
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32 Tactic: 5424417905073460656
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5424417905073460656 Time: 0.07856
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32 Tactic: 5442043907221427810
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5442043907221427810 Time: 0.295849
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 5544365258913999384
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5544365258913999384 Time: 0.282299
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 5721595115357140131
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5721595115357140131 Time: 0.131118
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 6004789655466615912
[11/24/2022-12:08:45] [V] [TRT] Tactic: 6004789655466615912 Time: 0.0884434
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 6146901278630392829
[11/24/2022-12:08:45] [V] [TRT] Tactic: 6146901278630392829 Time: 0.257522
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 6781129591847482048
[11/24/2022-12:08:45] [V] [TRT] Tactic: 6781129591847482048 Time: 0.114603
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 6984451771200230840
[11/24/2022-12:08:45] [V] [TRT] Tactic: 6984451771200230840 Time: 0.156622
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32 Tactic: 7077570591813340966
[11/24/2022-12:08:45] [V] [TRT] Tactic: 7077570591813340966 Time: 0.163927
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 7429976449747682901
[11/24/2022-12:08:45] [V] [TRT] Tactic: 7429976449747682901 Time: 0.148768
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 8096257414008860171
[11/24/2022-12:08:45] [V] [TRT] Tactic: 8096257414008860171 Time: 0.106101
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 8128112048355596715
[11/24/2022-12:08:45] [V] [TRT] Tactic: 8128112048355596715 Time: 0.084864
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 9064458886956700976
[11/24/2022-12:08:45] [V] [TRT] Tactic: 9064458886956700976 Time: 0.135472
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: -9165697322068360861
[11/24/2022-12:08:45] [V] [TRT] Tactic: -9165697322068360861 Time: 0.156343
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8691377209893505057
[11/24/2022-12:08:45] [V] [TRT] Tactic: -8691377209893505057 Time: 0.13603
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8520292213102999339
[11/24/2022-12:08:45] [V] [TRT] Tactic: -8520292213102999339 Time: 0.192128
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -8417388128970254446
[11/24/2022-12:08:45] [V] [TRT] Tactic: -8417388128970254446 Time: 0.21563
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8263994888336646547
[11/24/2022-12:08:45] [V] [TRT] Tactic: -8263994888336646547 Time: 0.128718
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8205948405243401049
[11/24/2022-12:08:45] [V] [TRT] Tactic: -8205948405243401049 Time: 0.152951
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -7898477046581738867
[11/24/2022-12:08:45] [V] [TRT] Tactic: -7898477046581738867 Time: 0.0776251
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -7683887278997527517
[11/24/2022-12:08:45] [V] [TRT] Tactic: -7683887278997527517 Time: 0.10013
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: -7381370635708568663
[11/24/2022-12:08:45] [V] [TRT] Tactic: -7381370635708568663 Time: 0.0922834
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -7129320389887881029
[11/24/2022-12:08:45] [V] [TRT] Tactic: -7129320389887881029 Time: 0.126453
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -6959995514028471820
[11/24/2022-12:08:45] [V] [TRT] Tactic: -6959995514028471820 Time: 0.19168
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: -6256128573036943404
[11/24/2022-12:08:45] [V] [TRT] Tactic: -6256128573036943404 Time: 0.163744
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -4933563390723451692
[11/24/2022-12:08:45] [V] [TRT] Tactic: -4933563390723451692 Time: 0.117872
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -3280888557222886418
[11/24/2022-12:08:45] [V] [TRT] Tactic: -3280888557222886418 Time: 0.102935
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -3238475748440751107
[11/24/2022-12:08:45] [V] [TRT] Tactic: -3238475748440751107 Time: 0.168535
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -3182884991006484042
[11/24/2022-12:08:45] [V] [TRT] Tactic: -3182884991006484042 Time: 0.0925303
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -3173468756112541306
[11/24/2022-12:08:45] [V] [TRT] Tactic: -3173468756112541306 Time: 0.148827
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -2741641298163591508
[11/24/2022-12:08:45] [V] [TRT] Tactic: -2741641298163591508 Time: 0.157161
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32 Tactic: -2054375205435666404
[11/24/2022-12:08:45] [V] [TRT] Tactic: -2054375205435666404 Time: 0.157015
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1546787387293556842
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1546787387293556842 Time: 0.121595
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: -1498626619443284096
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1498626619443284096 Time: 0.0934217
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1471245223605064669
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1471245223605064669 Time: 0.171502
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -1283580231568512025
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1283580231568512025 Time: 0.116494
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -1224421172675151280
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1224421172675151280 Time: 0.0830491
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -921247911551089037
[11/24/2022-12:08:45] [V] [TRT] Tactic: -921247911551089037 Time: 0.126921
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -762222380308749469
[11/24/2022-12:08:45] [V] [TRT] Tactic: -762222380308749469 Time: 0.128501
[11/24/2022-12:08:45] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -516725800067794372
[11/24/2022-12:08:45] [V] [TRT] Tactic: -516725800067794372 Time: 0.148919
[11/24/2022-12:08:45] [V] [TRT] Fastest Tactic: -7898477046581738867 Time: 0.0776251
[11/24/2022-12:08:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7898477046581738867
[11/24/2022-12:08:45] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:45] [V] [TRT] *************** Autotuning format combination: Float(1892352,59136,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:45] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudaDepthwiseConvolution)
[11/24/2022-12:08:45] [V] [TRT] Tactic: -1 Time: 0.221742
[11/24/2022-12:08:45] [V] [TRT] Fastest Tactic: -1 Time: 0.221742
[11/24/2022-12:08:45] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudnnConvolution)
[11/24/2022-12:08:45] [V] [TRT] Tactic: 0 Time: 0.446103
[11/24/2022-12:08:45] [V] [TRT] Tactic: 1 Time: 0.448599
[11/24/2022-12:08:45] [V] [TRT] Tactic: 2 Time: 0.447474
[11/24/2022-12:08:45] [V] [TRT] Tactic: 5 Time: 30.9986
[11/24/2022-12:08:45] [V] [TRT] Tactic: 6 Time: 3.82492
[11/24/2022-12:08:45] [V] [TRT] Tactic: 56 Time: 0.449307
[11/24/2022-12:08:45] [V] [TRT] Tactic: 57 Time: 0.449573
[11/24/2022-12:08:45] [V] [TRT] Tactic: 58 Time: 0.450555
[11/24/2022-12:08:45] [V] [TRT] Tactic: 61 Time: 30.3457
[11/24/2022-12:08:45] [V] [TRT] Tactic: 62 Time: 3.82694
[11/24/2022-12:08:45] [V] [TRT] Tactic: 112 Time: 0.449454
[11/24/2022-12:08:45] [V] [TRT] Tactic: 113 Time: 0.450208
[11/24/2022-12:08:45] [V] [TRT] Tactic: 114 Time: 0.449929
[11/24/2022-12:08:46] [V] [TRT] Tactic: 117 Time: 29.9605
[11/24/2022-12:08:46] [V] [TRT] Tactic: 118 Time: 3.91024
[11/24/2022-12:08:46] [V] [TRT] Fastest Tactic: 0 Time: 0.446103
[11/24/2022-12:08:46] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:08:46] [V] [TRT] Tactic: 130477820174479366 Time: 10.3948
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:08:46] [V] [TRT] Tactic: 1358952225285826925 Time: 5.90987
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:08:46] [V] [TRT] Tactic: 4549827808004681195 Time: 3.28558
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:08:46] [V] [TRT] Tactic: 5127140674766136213 Time: 5.07108
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:08:46] [V] [TRT] Tactic: 5691674214365884252 Time: 9.86138
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:08:46] [V] [TRT] Tactic: 5779835512569528575 Time: 6.61249
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:08:46] [V] [TRT] Tactic: 6053873026024413720 Time: 9.57707
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:08:46] [V] [TRT] Tactic: 6532229230713743445 Time: 10.6983
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:08:46] [V] [TRT] Tactic: 6767548733843469815 Time: 3.82951
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:08:46] [V] [TRT] Tactic: -7777264329408437990 Time: 3.84723
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:08:46] [V] [TRT] Tactic: -6693149634808211969 Time: 5.25345
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:08:46] [V] [TRT] Tactic: -6313876406580483184 Time: 1.72837
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:08:46] [V] [TRT] Tactic: -4932505327461806800 Time: 10.1148
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:08:46] [V] [TRT] Tactic: -2870780723387717246 Time: 5.9642
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:08:46] [V] [TRT] Tactic: -1123676555321336786 Time: 6.63645
[11/24/2022-12:08:46] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:08:46] [V] [TRT] Tactic: -701551393537224327 Time: 3.36641
[11/24/2022-12:08:46] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 1.72837
[11/24/2022-12:08:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:08:46] [V] [TRT] *************** Autotuning format combination: Float(1892352,1,10752,32) -> Float(1892352,1,10752,32) ***************
[11/24/2022-12:08:47] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:08:47] [V] [TRT] Tactic: 1852818056038333088 Time: 9.34868
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:08:47] [V] [TRT] Tactic: 2137271960938803767 Time: 8.53984
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:08:47] [V] [TRT] Tactic: 4543151729465212056 Time: 35.9307
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:08:47] [V] [TRT] Tactic: 5778138195697110002 Time: 12.3244
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:08:47] [V] [TRT] Tactic: 7098622778606028509 Time: 8.56749
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:08:47] [V] [TRT] Tactic: -9217704540809507511 Time: 9.76841
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:08:47] [V] [TRT] Tactic: -7734972403155710907 Time: 8.31532
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:08:47] [V] [TRT] Tactic: -3855385237722507463 Time: 12.4996
[11/24/2022-12:08:47] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:08:48] [V] [TRT] Tactic: -3360299822783115645 Time: 15.2126
[11/24/2022-12:08:48] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:08:48] [V] [TRT] Tactic: -2809379259463049392 Time: 12.3953
[11/24/2022-12:08:48] [V] [TRT] node_of_514 + node_of_515 + PWN(node_of_516) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:08:48] [V] [TRT] Tactic: -824800713406371346 Time: 8.10266
[11/24/2022-12:08:48] [V] [TRT] Fastest Tactic: -824800713406371346 Time: 8.10266
[11/24/2022-12:08:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -824800713406371346
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Float(473088,1:4,2688,8) -> Float(473088,1:4,2688,8) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Half(1892352,59136,336,1) -> Half(1892352,59136,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudnnConvolution)
[11/24/2022-12:08:48] [V] [TRT] Tactic: 0 Time: 0.196617
[11/24/2022-12:08:48] [V] [TRT] Tactic: 1 Time: 0.17787
[11/24/2022-12:08:48] [V] [TRT] Tactic: 2 Time: 0.391022
[11/24/2022-12:08:48] [V] [TRT] Tactic: 5 Time: 31.9717
[11/24/2022-12:08:48] [V] [TRT] Tactic: 6 Time: 11.8355
[11/24/2022-12:08:48] [V] [TRT] Tactic: 56 Time: 0.188686
[11/24/2022-12:08:48] [V] [TRT] Tactic: 58 Time: 0.400457
[11/24/2022-12:08:48] [V] [TRT] Tactic: 61 Time: 32.2701
[11/24/2022-12:08:48] [V] [TRT] Tactic: 62 Time: 12.0507
[11/24/2022-12:08:48] [V] [TRT] Fastest Tactic: 1 Time: 0.17787
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Half(946176,59136:2,336,1) -> Half(946176,59136:2,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,1344,4) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,1344,4) -> Half(236544,1:8,1344,4) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudaDepthwiseConvolution)
[11/24/2022-12:08:48] [V] [TRT] Tactic: -2 Time: 0.0673905
[11/24/2022-12:08:48] [V] [TRT] Fastest Tactic: -2 Time: 0.0673905
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Half(118272,1:16,672,2) -> Half(118272,1:16,672,2) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Half(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Int8(473088,59136:4,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudaDepthwiseConvolution)
[11/24/2022-12:08:48] [V] [TRT] Tactic: -5 Time: 0.16251
[11/24/2022-12:08:48] [V] [TRT] Fastest Tactic: -5 Time: 0.16251
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Int8(473088,59136:4,336,1) -> Int8(473088,59136:4,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudaDepthwiseConvolution)
[11/24/2022-12:08:48] [V] [TRT] Tactic: -3 Time: 0.0394297
[11/24/2022-12:08:48] [V] [TRT] Fastest Tactic: -3 Time: 0.0394297
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Int8(473088,59136:4,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Float(1892352,59136,336,1) ***************
[11/24/2022-12:08:48] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:48] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Float(59136,59136:32,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudaGroupConvolution)
[11/24/2022-12:08:49] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CudaDepthwiseConvolution)
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4 Time: 0.0368834
[11/24/2022-12:08:49] [V] [TRT] Tactic: 0 Time: 0.0342089
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1 Time: 0.0396171
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2 Time: 0.0328649
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3 Time: 0.0334519
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4 Time: 0.0325705
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5 Time: 0.0351241
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6 Time: 0.037856
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7 Time: 0.0353499
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8 Time: 0.0463451
[11/24/2022-12:08:49] [V] [TRT] Tactic: 9 Time: 0.0447371
[11/24/2022-12:08:49] [V] [TRT] Tactic: 10 Time: 0.0324955
[11/24/2022-12:08:49] [V] [TRT] Tactic: 11 Time: 0.0312933
[11/24/2022-12:08:49] [V] [TRT] Tactic: 12 Time: 0.0307895
[11/24/2022-12:08:49] [V] [TRT] Tactic: 13 Time: 0.0296357
[11/24/2022-12:08:49] [V] [TRT] Tactic: 14 Time: 0.0309248
[11/24/2022-12:08:49] [V] [TRT] Tactic: 15 Time: 0.0294382
[11/24/2022-12:08:49] [V] [TRT] Tactic: 16 Time: 0.0397143
[11/24/2022-12:08:49] [V] [TRT] Tactic: 17 Time: 0.0318473
[11/24/2022-12:08:49] [V] [TRT] Tactic: 18 Time: 0.0619002
[11/24/2022-12:08:49] [V] [TRT] Tactic: 19 Time: 0.0414914
[11/24/2022-12:08:49] [V] [TRT] Tactic: 20 Time: 0.0344549
[11/24/2022-12:08:49] [V] [TRT] Tactic: 21 Time: 0.0314295
[11/24/2022-12:08:49] [V] [TRT] Tactic: 22 Time: 0.0332955
[11/24/2022-12:08:49] [V] [TRT] Tactic: 23 Time: 0.0308654
[11/24/2022-12:08:49] [V] [TRT] Tactic: 24 Time: 0.0352357
[11/24/2022-12:08:49] [V] [TRT] Tactic: 25 Time: 0.0330057
[11/24/2022-12:08:49] [V] [TRT] Tactic: 26 Time: 0.0407131
[11/24/2022-12:08:49] [V] [TRT] Tactic: 27 Time: 0.0358811
[11/24/2022-12:08:49] [V] [TRT] Tactic: 28 Time: 0.0587535
[11/24/2022-12:08:49] [V] [TRT] Tactic: 29 Time: 0.0458617
[11/24/2022-12:08:49] [V] [TRT] Tactic: 30 Time: 0.0322706
[11/24/2022-12:08:49] [V] [TRT] Tactic: 31 Time: 0.0406434
[11/24/2022-12:08:49] [V] [TRT] Tactic: 32 Time: 0.0298057
[11/24/2022-12:08:49] [V] [TRT] Tactic: 33 Time: 0.0311415
[11/24/2022-12:08:49] [V] [TRT] Tactic: 34 Time: 0.0280244
[11/24/2022-12:08:49] [V] [TRT] Tactic: 35 Time: 0.0309906
[11/24/2022-12:08:49] [V] [TRT] Tactic: 36 Time: 0.0394491
[11/24/2022-12:08:49] [V] [TRT] Tactic: 37 Time: 0.0303552
[11/24/2022-12:08:49] [V] [TRT] Tactic: 38 Time: 0.0465486
[11/24/2022-12:08:49] [V] [TRT] Tactic: 39 Time: 0.0337207
[11/24/2022-12:08:49] [V] [TRT] Tactic: 40 Time: 0.0307109
[11/24/2022-12:08:49] [V] [TRT] Tactic: 41 Time: 0.0303287
[11/24/2022-12:08:49] [V] [TRT] Tactic: 42 Time: 0.0286473
[11/24/2022-12:08:49] [V] [TRT] Tactic: 43 Time: 0.0275223
[11/24/2022-12:08:49] [V] [TRT] Tactic: 44 Time: 0.0315575
[11/24/2022-12:08:49] [V] [TRT] Tactic: 45 Time: 0.0286747
[11/24/2022-12:08:49] [V] [TRT] Tactic: 46 Time: 0.0370983
[11/24/2022-12:08:49] [V] [TRT] Tactic: 47 Time: 0.0287415
[11/24/2022-12:08:49] [V] [TRT] Tactic: 48 Time: 0.0548236
[11/24/2022-12:08:49] [V] [TRT] Tactic: 49 Time: 0.0457737
[11/24/2022-12:08:49] [V] [TRT] Tactic: 50 Time: 0.0326683
[11/24/2022-12:08:49] [V] [TRT] Tactic: 51 Time: 0.0305819
[11/24/2022-12:08:49] [V] [TRT] Tactic: 52 Time: 0.0323182
[11/24/2022-12:08:49] [V] [TRT] Tactic: 53 Time: 0.0272328
[11/24/2022-12:08:49] [V] [TRT] Tactic: 54 Time: 0.0351534
[11/24/2022-12:08:49] [V] [TRT] Tactic: 55 Time: 0.0254827
[11/24/2022-12:08:49] [V] [TRT] Tactic: 56 Time: 0.0390994
[11/24/2022-12:08:49] [V] [TRT] Tactic: 57 Time: 0.0323977
[11/24/2022-12:08:49] [V] [TRT] Tactic: 58 Time: 0.0505524
[11/24/2022-12:08:49] [V] [TRT] Tactic: 59 Time: 0.0449623
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: 55 Time: 0.0254827
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_514 + node_of_515 + PWN(node_of_516) (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 55
[11/24/2022-12:08:49] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Float(1892352,59136,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudaDepthwiseConvolution)
[11/24/2022-12:08:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (FusedConvActConvolution)
[11/24/2022-12:08:49] [V] [TRT] Tactic: 589823 Time: 0.352311
[11/24/2022-12:08:49] [V] [TRT] Tactic: 655359 Time: 0.392041
[11/24/2022-12:08:49] [V] [TRT] Tactic: 786431 Time: 0.224014
[11/24/2022-12:08:49] [V] [TRT] Tactic: 851967 Time: 0.594898
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1179647 Time: 0.316736
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1638399 Time: 0.220146
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2097151 Time: 0.259698
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3538943 Time: 0.270725
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3932159 Time: 0.378793
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3997695 Time: 0.206789
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4194303 Time: 0.209737
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4259839 Time: 0.237641
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4587519 Time: 0.179785
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4653055 Time: 0.347598
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4915199 Time: 0.203022
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4980735 Time: 0.209568
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5177343 Time: 0.327515
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5242879 Time: 0.25813
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5373951 Time: 0.370917
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5570559 Time: 0.451959
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5767167 Time: 0.68539
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5898239 Time: 0.340704
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6225919 Time: 0.251739
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6291455 Time: 0.316448
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6815743 Time: 0.297312
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7012351 Time: 0.260741
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7077887 Time: 0.23483
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7143423 Time: 0.353499
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7208959 Time: 0.255113
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7340031 Time: 0.353202
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7536639 Time: 0.488704
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7733247 Time: 0.255072
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8191999 Time: 0.275657
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8716287 Time: 0.323538
[11/24/2022-12:08:49] [V] [TRT] Tactic: 9109503 Time: 0.267401
[11/24/2022-12:08:49] [V] [TRT] Tactic: 9568255 Time: 0.202921
[11/24/2022-12:08:49] [V] [TRT] Tactic: 10354687 Time: 0.203872
[11/24/2022-12:08:49] [V] [TRT] Tactic: 10747903 Time: 0.25088
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: 4587519 Time: 0.179785
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudnnConvolution)
[11/24/2022-12:08:49] [V] [TRT] Tactic: 0 Time: 0.150309
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1 Time: 0.151008
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2 Time: 0.260946
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5 Time: 0.441938
[11/24/2022-12:08:49] [V] [TRT] Tactic: 56 Time: 0.151675
[11/24/2022-12:08:49] [V] [TRT] Tactic: 57 Time: 0.150752
[11/24/2022-12:08:49] [V] [TRT] Tactic: 58 Time: 0.259136
[11/24/2022-12:08:49] [V] [TRT] Tactic: 61 Time: 0.437381
[11/24/2022-12:08:49] [V] [TRT] Tactic: 112 Time: 0.153161
[11/24/2022-12:08:49] [V] [TRT] Tactic: 113 Time: 0.153243
[11/24/2022-12:08:49] [V] [TRT] Tactic: 114 Time: 0.260256
[11/24/2022-12:08:49] [V] [TRT] Tactic: 117 Time: 0.437015
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: 0 Time: 0.150309
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:08:49] [V] [TRT] Tactic: 621442388677115936 Time: 0.532667
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:08:49] [V] [TRT] Tactic: 697756878388249475 Time: 0.236485
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1159272950022995759 Time: 0.228091
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1327459216264546184 Time: 0.28747
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2290218393647758202 Time: 0.198738
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2310520233542099555 Time: 0.469979
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3377996665278764661 Time: 0.761147
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4032904638566464623 Time: 0.278555
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4549827808004681195 Time: 0.143474
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4918658762935651592 Time: 0.475557
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5779835512569528575 Time: 0.277815
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5837905844602864231 Time: 0.336672
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6166883504066133838 Time: 0.392082
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6210049212073459059 Time: 0.217765
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6500866402607985231 Time: 0.30533
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6723161876874263939 Time: 0.177605
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6868013466259746979 Time: 0.419287
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6901214267543238617 Time: 0.321577
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8048119769507926928 Time: 0.488759
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:08:49] [V] [TRT] Tactic: 9151672657204310840 Time: 0.244466
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8877086111929938764 Time: 0.295259
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8766093103475083267 Time: 0.204101
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8198656951359619379 Time: 0.208265
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0954286
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7145578994937510651 Time: 0.376969
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7070045993088702524 Time: 0.713989
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:08:49] [V] [TRT] Tactic: -6622064180404051845 Time: 0.229394
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:08:49] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0977623
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:08:49] [V] [TRT] Tactic: -6273689210331812572 Time: 0.274336
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4562045946847239058 Time: 0.396882
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4337126844824617177 Time: 0.140567
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:08:49] [V] [TRT] Tactic: -2777237991111865351 Time: 0.488544
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1918478037390720253 Time: 0.223227
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1349585930542925704 Time: 0.391895
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1123676555321336786 Time: 0.279154
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:08:49] [V] [TRT] Tactic: -701551393537224327 Time: 0.145074
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:08:49] [V] [TRT] Tactic: -3258434593395023 Time: 0.358816
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0954286
[11/24/2022-12:08:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Float(1892352,1,10752,32) -> Float(946176,1,5376,16) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1162498931361159915 Time: 0.309129
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1663866669559596164 Time: 0.229253
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2860655430572478466 Time: 0.171109
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3887292144336338310 Time: 0.166757
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4474630279712975759 Time: 0.140658
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4479823862704990365 Time: 0.139863
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4696204239951173149 Time: 0.17136
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5778138195697110003 Time: 0.231703
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6185707384100198445 Time: 0.167739
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8918020581761223752 Time: 0.229001
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8031737312007363273 Time: 0.160622
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:08:49] [V] [TRT] Tactic: -5905193483742532701 Time: 0.166368
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4896615592193611463 Time: 0.18933
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4056705536979434560 Time: 0.296855
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4035591156787122265 Time: 0.137365
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:08:49] [V] [TRT] Tactic: -3071763921328736248 Time: 0.15984
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:08:49] [V] [TRT] Tactic: -2809379259463049391 Time: 0.23328
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1985235291706575900 Time: 0.226441
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:08:49] [V] [TRT] Tactic: -504296718212024303 Time: 0.229312
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.137365
[11/24/2022-12:08:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Float(473088,1:4,2688,8) -> Float(236544,1:4,1344,4) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1373022415249282411 Time: 0.126203
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2536540085349545921 Time: 0.111689
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3119404851233737725 Time: 0.128363
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5108195418077987197 Time: 0.195831
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5380043773350002416 Time: 0.146409
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5610788582700027969 Time: 0.100183
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6031243482516294286 Time: 0.187278
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6419443404913215692 Time: 0.143529
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6571171993204510025 Time: 0.251657
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6832381412128253616 Time: 0.240471
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7058864664858220889 Time: 0.168832
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8853476220903838035 Time: 0.173888
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7067026478815706014 Time: 0.122848
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:08:49] [V] [TRT] Tactic: -6407735577805887428 Time: 0.219931
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:08:49] [V] [TRT] Tactic: -6073218138311523634 Time: 0.151438
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:08:49] [V] [TRT] Tactic: -5033173285090644307 Time: 0.226286
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:08:49] [V] [TRT] Tactic: -5010594849215755610 Time: 0.179282
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1450865838092804082 Time: 0.25915
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1366318165940453381 Time: 0.192969
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1138876066247138089 Time: 0.14688
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: 5610788582700027969 Time: 0.100183
[11/24/2022-12:08:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5610788582700027969
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Half(1892352,59136,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudnnConvolution)
[11/24/2022-12:08:49] [V] [TRT] Tactic: 0 Time: 0.14592
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1 Time: 0.127077
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2 Time: 0.376133
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5 Time: 0.426885
[11/24/2022-12:08:49] [V] [TRT] Tactic: 56 Time: 0.145655
[11/24/2022-12:08:49] [V] [TRT] Tactic: 58 Time: 0.375707
[11/24/2022-12:08:49] [V] [TRT] Tactic: 61 Time: 0.423899
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: 1 Time: 0.127077
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Half(946176,59136:2,336,1) -> Half(946176,59136,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Half(946176,59136:2,336,1) -> Half(473088,59136:2,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (FusedConvActConvolution)
[11/24/2022-12:08:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0656853
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3891805945559659536 Time: 0.267895
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4418200634486186714 Time: 0.10093
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0892457
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0874651
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0539368
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4884039206922900293 Time: 0.174226
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:08:49] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0636769
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:08:49] [V] [TRT] Tactic: -1546027692247304867 Time: 0.267049
[11/24/2022-12:08:49] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0539368
[11/24/2022-12:08:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,1344,4) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] *************** Autotuning format combination: Half(236544,1:8,1344,4) -> Half(118272,1:8,672,2) ***************
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudaDepthwiseConvolution)
[11/24/2022-12:08:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:49] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:08:49] [V] [TRT] Tactic: 254850674756030979 Time: 0.124827
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1016009564074305832 Time: 0.125609
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0921394
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1156328698016730421 Time: 0.120789
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 1236070762725864170
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1236070762725864170 Time: 0.0494705
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 1297835561412423383
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1297835561412423383 Time: 0.0491611
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0590141
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 1484051751570462061
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1484051751570462061 Time: 0.0506469
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1576319725282257846 Time: 0.307621
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 1710761387006445904
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1710761387006445904 Time: 0.0524998
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 1788275858806332606
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1788275858806332606 Time: 0.0401931
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1832046141070096030 Time: 0.152471
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0998171
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 1876080869840372148
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1876080869840372148 Time: 0.0448446
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1877373136269439559 Time: 0.275579
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:08:49] [V] [TRT] Tactic: 1899296423087490472 Time: 0.160297
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 2014386895388196995
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2014386895388196995 Time: 0.0401131
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2238656696610018305 Time: 0.173536
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 2285052789339973171
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2285052789339973171 Time: 0.0502918
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2541579301352125276 Time: 0.105675
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2559328254295148085 Time: 0.17221
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2657157263811141609 Time: 0.274821
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 2885411890874123330
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2885411890874123330 Time: 0.0492587
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:08:49] [V] [TRT] Tactic: 2968605903460894194 Time: 0.100457
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 3014367713063089410
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3014367713063089410 Time: 0.0359794
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0837463
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 3094146840800930111
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3094146840800930111 Time: 0.0395657
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 3111630609330706559
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3111630609330706559 Time: 0.0509044
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 3293261797412283333
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3293261797412283333 Time: 0.0516907
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 3355662717192093688
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3355662717192093688 Time: 0.0521158
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0434606
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3362537467505018070 Time: 0.178194
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3513075359009385578 Time: 0.133845
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3704534001553878387 Time: 0.117291
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 3821081349796384238
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3821081349796384238 Time: 0.0559192
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0911954
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 3900825777106964947
[11/24/2022-12:08:49] [V] [TRT] Tactic: 3900825777106964947 Time: 0.0572358
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4278315135102886928 Time: 0.258624
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4370476717970497892 Time: 0.041672
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0630232
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0957646
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4528997467275241200 Time: 0.049408
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4540505769798915372 Time: 0.107298
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4571819373777460444 Time: 0.128699
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4595173549602041350 Time: 0.168526
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4802447371470387646 Time: 0.111664
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:08:49] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0609783
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5059676457552313631 Time: 0.126775
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5070322914990170527 Time: 0.118192
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5205510332404400949 Time: 0.101495
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5346855796032465921 Time: 0.150496
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:08:49] [V] [TRT] Tactic: 5398999388616959893 Time: 0.116281
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 6006391580592745401
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6006391580592745401 Time: 0.0606415
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6034364043891107501 Time: 0.145659
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6372404953297521067 Time: 0.119559
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 6373920594237855975
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6373920594237855975 Time: 0.057955
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6377497238381488891 Time: 0.174725
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6468794451065529747 Time: 0.172786
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 6580047526417007834
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6580047526417007834 Time: 0.0537219
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6697277555581639516 Time: 0.098112
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6724319788728799540 Time: 0.285033
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:08:49] [V] [TRT] Tactic: 6859477213531075460 Time: 0.144795
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0650194
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7609923741161019135 Time: 0.089264
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 7671477676541500689
[11/24/2022-12:08:49] [V] [TRT] Tactic: 7671477676541500689 Time: 0.111778
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0999794
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8101703987960976805 Time: 0.16155
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8170606396342855895 Time: 0.165851
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 8270193703352283962
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8270193703352283962 Time: 0.0487406
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 8609386743006631101
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8609386743006631101 Time: 0.0431291
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 8612200391988441496
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8612200391988441496 Time: 0.0390811
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8764780417487154889 Time: 0.113237
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0685166
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:08:49] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0638339
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:08:49] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0393566
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:08:49] [V] [TRT] Tactic: -9009272790678027912 Time: 0.113573
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8604374562669615024 Time: 0.2496
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8280443484414412687 Time: 0.123611
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0982971
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0728503
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -8006601114930636709
[11/24/2022-12:08:49] [V] [TRT] Tactic: -8006601114930636709 Time: 0.0504899
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -7798149971944012698
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7798149971944012698 Time: 0.0464366
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -7683747554614165540
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7683747554614165540 Time: 0.0501592
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -7604212447063563295
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7604212447063563295 Time: 0.0492373
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -7528383910611180842
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7528383910611180842 Time: 0.0397749
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -7428355835493435592
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7428355835493435592 Time: 0.0452583
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7410012245391920273 Time: 0.26043
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -7109456194156851009
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7109456194156851009 Time: 0.0497935
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7099920365135295801 Time: 0.101211
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:08:49] [V] [TRT] Tactic: -7089118800560870395 Time: 0.224384
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -6789949785717718640
[11/24/2022-12:08:49] [V] [TRT] Tactic: -6789949785717718640 Time: 0.0477089
[11/24/2022-12:08:49] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0790171
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -6594872535430699497
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6594872535430699497 Time: 0.0499246
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -6510960431881136297
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6510960431881136297 Time: 0.0394743
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6356316196810535311 Time: 0.289989
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6063766379489217211 Time: 0.146409
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5530886555766748586 Time: 0.104997
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0359371
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5261787675443473128 Time: 0.103991
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5161596964442251102 Time: 0.176827
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5127240325355316006 Time: 0.147122
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5109582882231362997 Time: 0.127943
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -5082750115275722821
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5082750115275722821 Time: 0.063875
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4950923835688973492 Time: 0.095952
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4796511246675321840 Time: 0.314761
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4548822885169694805 Time: 0.152571
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0878583
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4293222705763522367 Time: 0.134757
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4152066959007262150 Time: 0.131737
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4021926646879732549 Time: 0.266254
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3987638434926559037 Time: 0.321957
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3905653247016903130 Time: 0.118491
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3903342530518878192 Time: 0.06496
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0680168
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3601464762214218301 Time: 0.142706
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0816183
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3200815656917281917 Time: 0.110055
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -3168858964887995726
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3168858964887995726 Time: 0.0523048
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3058330359340425555 Time: 0.175904
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0470686
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2602982885923184927 Time: 0.169056
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -2590123377344686639
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2590123377344686639 Time: 0.0627063
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -2365592821493052948
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2365592821493052948 Time: 0.0652602
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2353603993968373338 Time: 0.103205
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2032577876140256150 Time: 0.15472
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2003055242756584050 Time: 0.142617
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0687177
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -1935873158869965959
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1935873158869965959 Time: 0.105029
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -1871293198177288380
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1871293198177288380 Time: 0.106048
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0796023
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0934926
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0827657
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1242202084391243207 Time: 0.24971
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1099247066487349374 Time: 0.235762
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1038291877007553549 Time: 0.139991
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -563413451241559339
[11/24/2022-12:08:50] [V] [TRT] Tactic: -563413451241559339 Time: 0.0494095
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: -517813403956506640
[11/24/2022-12:08:50] [V] [TRT] Tactic: -517813403956506640 Time: 0.0334583
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:08:50] [V] [TRT] Tactic: -406984317033388136 Time: 0.114549
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -356933163344202008
[11/24/2022-12:08:50] [V] [TRT] Tactic: -356933163344202008 Time: 0.0494811
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:08:50] [V] [TRT] Tactic: -331499326992534460 Time: 0.0843726
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: -291069119579384883
[11/24/2022-12:08:50] [V] [TRT] Tactic: -291069119579384883 Time: 0.0313015
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:08:50] [V] [TRT] Tactic: -206523504474952360 Time: 0.145175
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -175265966321316526
[11/24/2022-12:08:50] [V] [TRT] Tactic: -175265966321316526 Time: 0.0441714
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -93196984589102737
[11/24/2022-12:08:50] [V] [TRT] Tactic: -93196984589102737 Time: 0.0488442
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -291069119579384883 Time: 0.0313015
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -291069119579384883
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Half(118272,1:16,672,2) -> Half(59136,1:16,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Half(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CublasConvolution)
[11/24/2022-12:08:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(473088,59136:4,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudaDepthwiseConvolution)
[11/24/2022-12:08:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1508480131241957639 Time: 0.192667
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2141154648944475104 Time: 0.191593
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3239257003214966313 Time: 0.19237
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0648183
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0954697
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0568229
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0965714
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0632351
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0592152
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0658133
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:08:50] [V] [TRT] Tactic: -108011214168778087 Time: 0.0576914
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:08:50] [V] [TRT] Tactic: -42427192380281294 Time: 0.0938331
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0568229
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(473088,59136:4,336,1) -> Int8(236544,59136:4,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudaDepthwiseConvolution)
[11/24/2022-12:08:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (FusedConvActConvolution)
[11/24/2022-12:08:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:08:50] [V] [TRT] Tactic: 175853789719975416 Time: 0.035832
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2171150287007712632 Time: 0.04088
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0584442
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0623756
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6299962968199310600 Time: 0.114923
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0378709
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0352713
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0572343
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0394011
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6585664687867083638 Time: 0.11816
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0334994
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:08:50] [V] [TRT] Tactic: -683636008127039856 Time: 0.11667
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.0334994
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(473088,59136:4,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0412709
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2855900226702061782 Time: 0.119707
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0599619
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4325765560739862899 Time: 0.119941
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0583177
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0385223
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0434754
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4255737803793506479 Time: 0.125022
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3958182351168863467 Time: 0.042928
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0468491
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0404503
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:08:50] [V] [TRT] Tactic: -868495160148524802 Time: 0.061312
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.0385223
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Float(946176,59136,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0573928
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0556815
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0671314
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: 5104832031493112835 Time: 0.0556815
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5104832031493112835
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Float(59136,59136:32,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0705158
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0690591
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0630202
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0825554
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5012796702462679112 Time: 0.12989
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6556170942941957134 Time: 0.11749
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0654202
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6969462133921577484 Time: 0.153403
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0918743
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0644404
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7970271430402365872 Time: 0.103803
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0658027
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8912999970161746151 Time: 0.10848
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0720869
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8069335661823714580 Time: 0.100091
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7988637803896331454 Time: 0.116994
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7957004747664952265 Time: 0.145239
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7904635102498369361 Time: 0.12893
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0701623
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0844777
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7282232519526877434 Time: 0.131081
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0613836
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0753851
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0845029
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5416590980288859834 Time: 0.113995
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0728526
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3665201838779845683 Time: 0.106171
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3644377136375731441 Time: 0.083392
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0964777
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2342404147487779225 Time: 0.08296
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0844091
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:08:50] [V] [TRT] Tactic: -621838502160440068 Time: 0.0857897
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.0613836
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Half(59136,59136:32,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:08:50] [V] [TRT] Tactic: 424230345342282109 Time: 0.0680305
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0447097
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2327398338581585326 Time: 0.108382
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0638583
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4549109251242445288 Time: 0.124818
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0798606
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0915657
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7178538052023824067 Time: 0.109015
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7507411019787288861 Time: 0.049728
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7515859573761964679 Time: 0.128441
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0970811
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0930309
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0781989
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0519086
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8471142395703548718 Time: 0.055171
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:08:50] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0768389
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0689341
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0446503
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0618621
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0697554
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0698133
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0857554
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6079719874915919252 Time: 0.145582
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0666179
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0480533
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0608381
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3556614738549917282 Time: 0.107968
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3514726588976755320 Time: 0.156146
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0522362
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1712174008006584201 Time: 0.125511
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0687878
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:08:50] [V] [TRT] Tactic: -50323486981480818 Time: 0.0671497
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.0446503
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Int8(59136,59136:32,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudaGroupConvolution)
[11/24/2022-12:08:50] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CudaDepthwiseConvolution)
[11/24/2022-12:08:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (FusedConvActConvolution)
[11/24/2022-12:08:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_517 + node_of_518 (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:08:50] [V] [TRT] Tactic: 125145153013230687 Time: 0.122
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1583811548148740665 Time: 0.112208
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0761006
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0318245
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0476617
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0738926
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0560869
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0716366
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0464663
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0800526
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0551604
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0398469
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0697493
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0377737
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0712564
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0831634
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0595733
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0421417
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0742057
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6443933097134654777 Time: 0.150098
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0870446
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0639604
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0699429
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0961234
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:08:50] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0462834
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8142283985160822229 Time: 0.075856
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8173975624668590862 Time: 0.135689
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0809966
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0704686
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:08:50] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0767497
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:08:50] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0770286
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:08:50] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0789806
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0417989
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0432434
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:08:50] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0844229
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0729829
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0853737
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:08:50] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0710354
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0538575
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0635779
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0751657
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:08:50] [V] [TRT] Tactic: -4151617293257698859 Time: 0.163625
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0358183
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0466
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:08:50] [V] [TRT] Tactic: -3288585994448820820 Time: 0.116455
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0332599
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2432868635536396215 Time: 0.100754
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:08:50] [V] [TRT] Tactic: -2315453944962430928 Time: 0.139598
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1916483171117495388 Time: 0.087952
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0852869
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0825851
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:08:50] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0307813
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:08:50] [V] [TRT] Tactic: -405554772060757402 Time: 0.046632
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:08:50] [V] [TRT] Tactic: -375949437730908730 Time: 0.052483
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:08:50] [V] [TRT] Tactic: -111878368089469751 Time: 0.0638811
[11/24/2022-12:08:50] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:08:50] [V] [TRT] Tactic: -19707840769375107 Time: 0.0322606
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: -1006589727652607355 Time: 0.0307813
[11/24/2022-12:08:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1006589727652607355
[11/24/2022-12:08:50] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:50] [V] [TRT] *************** Autotuning format combination: Float(946176,59136,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudaDepthwiseConvolution)
[11/24/2022-12:08:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (FusedConvActConvolution)
[11/24/2022-12:08:50] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudnnConvolution)
[11/24/2022-12:08:50] [V] [TRT] Tactic: 0 Time: 0.943493
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1 Time: 0.739063
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2 Time: 1.01007
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5 Time: 1.41432
[11/24/2022-12:08:50] [V] [TRT] Tactic: 56 Time: 0.961655
[11/24/2022-12:08:50] [V] [TRT] Tactic: 57 Time: 0.750057
[11/24/2022-12:08:50] [V] [TRT] Tactic: 58 Time: 1.0169
[11/24/2022-12:08:50] [V] [TRT] Tactic: 61 Time: 1.42625
[11/24/2022-12:08:50] [V] [TRT] Tactic: 112 Time: 0.954272
[11/24/2022-12:08:50] [V] [TRT] Tactic: 113 Time: 0.788347
[11/24/2022-12:08:50] [V] [TRT] Tactic: 114 Time: 1.01502
[11/24/2022-12:08:50] [V] [TRT] Tactic: 117 Time: 1.41717
[11/24/2022-12:08:50] [V] [TRT] Fastest Tactic: 1 Time: 0.739063
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:50] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:08:50] [V] [TRT] Tactic: 621442388677115936 Time: 0.537038
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:08:50] [V] [TRT] Tactic: 697756878388249475 Time: 0.664046
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1159272950022995759 Time: 0.446642
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:08:50] [V] [TRT] Tactic: 1327459216264546184 Time: 0.80192
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2290218393647758202 Time: 0.321714
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:08:50] [V] [TRT] Tactic: 2310520233542099555 Time: 0.476037
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:08:50] [V] [TRT] Tactic: 3377996665278764661 Time: 0.654286
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4032904638566464623 Time: 0.533129
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4549827808004681195 Time: 0.251794
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:08:50] [V] [TRT] Tactic: 4918658762935651592 Time: 0.932969
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5779835512569528575 Time: 0.242139
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:08:50] [V] [TRT] Tactic: 5837905844602864231 Time: 0.328384
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6166883504066133838 Time: 0.398697
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6210049212073459059 Time: 0.397211
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6500866402607985231 Time: 0.599086
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6723161876874263939 Time: 0.335963
[11/24/2022-12:08:50] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:08:50] [V] [TRT] Tactic: 6868013466259746979 Time: 0.424736
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6901214267543238617 Time: 0.633271
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8048119769507926928 Time: 0.497563
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:08:51] [V] [TRT] Tactic: 9151672657204310840 Time: 0.245769
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8877086111929938764 Time: 0.282688
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8766093103475083267 Time: 0.341952
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8198656951359619379 Time: 0.332475
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7491730084094677098 Time: 0.225243
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7145578994937510651 Time: 0.329582
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7070045993088702524 Time: 0.592768
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6622064180404051845 Time: 0.225125
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6313876406580483184 Time: 0.230235
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6273689210331812572 Time: 0.242208
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4562045946847239058 Time: 0.338555
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4337126844824617177 Time: 0.248727
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2777237991111865351 Time: 0.496334
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1918478037390720253 Time: 0.354939
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1349585930542925704 Time: 0.771182
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1123676555321336786 Time: 0.244347
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:08:51] [V] [TRT] Tactic: -701551393537224327 Time: 0.253961
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3258434593395023 Time: 0.297646
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: -6622064180404051845 Time: 0.225125
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6622064180404051845
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Float(946176,1,5376,16) -> Float(5677056,1,32256,96) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1162498931361159915 Time: 0.256846
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1663866669559596164 Time: 0.203515
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2860655430572478466 Time: 0.286277
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3887292144336338310 Time: 0.262213
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4474630279712975759 Time: 0.399003
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4479823862704990365 Time: 0.396617
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4696204239951173149 Time: 0.287872
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5778138195697110003 Time: 0.205234
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6185707384100198445 Time: 0.260142
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8918020581761223752 Time: 0.205129
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8031737312007363273 Time: 0.245019
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5905193483742532701 Time: 0.281879
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4896615592193611463 Time: 0.285984
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4056705536979434560 Time: 0.248901
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4035591156787122265 Time: 0.388421
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3071763921328736248 Time: 0.249371
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2809379259463049391 Time: 0.20485
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1985235291706575900 Time: 0.201934
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:08:51] [V] [TRT] Tactic: -504296718212024303 Time: 0.204923
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: -1985235291706575900 Time: 0.201934
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1985235291706575900
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Float(236544,1:4,1344,4) -> Float(1419264,1:4,8064,24) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1373022415249282411 Time: 0.158341
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2536540085349545921 Time: 0.227762
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3119404851233737725 Time: 0.270949
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5108195418077987197 Time: 0.410958
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5380043773350002416 Time: 0.307195
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5610788582700027969 Time: 0.210528
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6031243482516294286 Time: 0.222839
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6419443404913215692 Time: 0.171634
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6571171993204510025 Time: 0.269184
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6832381412128253616 Time: 0.285897
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:08:51] [V] [TRT] Tactic: 7058864664858220889 Time: 0.330862
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8853476220903838035 Time: 0.474331
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7067026478815706014 Time: 0.158656
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6407735577805887428 Time: 0.442222
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6073218138311523634 Time: 0.180096
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5033173285090644307 Time: 0.283095
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5010594849215755610 Time: 0.219328
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1450865838092804082 Time: 0.274281
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1366318165940453381 Time: 0.518761
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1138876066247138089 Time: 0.288997
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: 1373022415249282411 Time: 0.158341
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1373022415249282411
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(946176,59136,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudnnConvolution)
[11/24/2022-12:08:51] [V] [TRT] Tactic: 0 Time: 0.782025
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1 Time: 0.696887
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2 Time: 0.862327
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5 Time: 1.36834
[11/24/2022-12:08:51] [V] [TRT] Tactic: 56 Time: 0.782798
[11/24/2022-12:08:51] [V] [TRT] Tactic: 58 Time: 0.855717
[11/24/2022-12:08:51] [V] [TRT] Tactic: 61 Time: 1.35155
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: 1 Time: 0.696887
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(473088,59136:2,336,1) -> Half(5677056,59136,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(473088,59136:2,336,1) -> Half(2838528,59136:2,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (FusedConvActConvolution)
[11/24/2022-12:08:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2195670545862694453 Time: 0.149513
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3891805945559659536 Time: 0.235666
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4418200634486186714 Time: 0.177381
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5548126322150286555 Time: 0.149691
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6057304366605292508 Time: 0.147904
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:08:51] [V] [TRT] Tactic: 7392644644614664811 Time: 0.119045
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4884039206922900293 Time: 0.158414
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4374269919094467161 Time: 0.148288
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1546027692247304867 Time: 0.233938
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.119045
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(118272,1:8,672,2) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(118272,1:8,672,2) -> Half(709632,1:8,4032,12) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudaDepthwiseConvolution)
[11/24/2022-12:08:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:08:51] [V] [TRT] Tactic: 254850674756030979 Time: 0.147593
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1016009564074305832 Time: 0.147707
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1044128949445110119 Time: 0.163986
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1156328698016730421 Time: 0.14133
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1362727228442059924 Time: 0.127248
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1576319725282257846 Time: 0.312411
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1832046141070096030 Time: 0.300905
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1838082074606840426 Time: 0.193902
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1877373136269439559 Time: 0.282427
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1899296423087490472 Time: 0.317385
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2238656696610018305 Time: 0.183744
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2541579301352125276 Time: 0.124258
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2559328254295148085 Time: 0.177285
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2657157263811141609 Time: 0.544206
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2968605903460894194 Time: 0.198309
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3071479995783211391 Time: 0.226798
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3359475309458902373 Time: 0.115189
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3362537467505018070 Time: 0.19141
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3513075359009385578 Time: 0.156599
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3704534001553878387 Time: 0.139895
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3899310434460415852 Time: 0.193019
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4278315135102886928 Time: 0.277179
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4370476717970497892 Time: 0.112512
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4480294673430783793 Time: 0.131262
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4491683531415781597 Time: 0.113486
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0996434
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4540505769798915372 Time: 0.212489
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4571819373777460444 Time: 0.151017
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4595173549602041350 Time: 0.176741
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4802447371470387646 Time: 0.213111
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4993757826442493905 Time: 0.131008
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5059676457552313631 Time: 0.147694
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5070322914990170527 Time: 0.144709
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5205510332404400949 Time: 0.122336
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5346855796032465921 Time: 0.156283
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5398999388616959893 Time: 0.218962
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6034364043891107501 Time: 0.174491
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6372404953297521067 Time: 0.130016
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6377497238381488891 Time: 0.19029
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6468794451065529747 Time: 0.340375
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6697277555581639516 Time: 0.121851
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6724319788728799540 Time: 0.290811
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6859477213531075460 Time: 0.303195
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:08:51] [V] [TRT] Tactic: 7216571380637776659 Time: 0.131703
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:08:51] [V] [TRT] Tactic: 7609923741161019135 Time: 0.187269
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8095507026323593899 Time: 0.195383
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8101703987960976805 Time: 0.325673
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8170606396342855895 Time: 0.325975
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8764780417487154889 Time: 0.21456
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8823554289762712606 Time: 0.144096
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8839784824303350101 Time: 0.129013
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:08:51] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0948343
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:08:51] [V] [TRT] Tactic: -9009272790678027912 Time: 0.216178
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8604374562669615024 Time: 0.500206
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8280443484414412687 Time: 0.145339
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8205952393017864204 Time: 0.114587
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8131857373260504832 Time: 0.141216
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7410012245391920273 Time: 0.521687
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7099920365135295801 Time: 0.124521
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7089118800560870395 Time: 0.448398
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0948526
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6356316196810535311 Time: 0.5752
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6063766379489217211 Time: 0.287127
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5530886555766748586 Time: 0.124245
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5409588854490562130 Time: 0.10443
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5261787675443473128 Time: 0.204402
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5161596964442251102 Time: 0.190587
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5127240325355316006 Time: 0.177024
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5109582882231362997 Time: 0.149056
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4950923835688973492 Time: 0.194066
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4796511246675321840 Time: 0.320782
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4548822885169694805 Time: 0.304027
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4379519430184503304 Time: 0.185504
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4293222705763522367 Time: 0.280114
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4152066959007262150 Time: 0.153513
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4021926646879732549 Time: 0.28437
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3987638434926559037 Time: 0.328027
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3905653247016903130 Time: 0.222651
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3903342530518878192 Time: 0.134903
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3864869056275745423 Time: 0.139509
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3601464762214218301 Time: 0.294386
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3234716536615144018 Time: 0.153367
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3200815656917281917 Time: 0.128098
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3058330359340425555 Time: 0.189243
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2878731503146438856 Time: 0.102809
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2602982885923184927 Time: 0.184777
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2353603993968373338 Time: 0.206299
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2032577876140256150 Time: 0.311182
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2003055242756584050 Time: 0.170427
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1985778916402815946 Time: 0.14251
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1828674067637788567 Time: 0.222121
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1640527254204634147 Time: 0.189499
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0963109
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1242202084391243207 Time: 0.268032
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1099247066487349374 Time: 0.471986
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1038291877007553549 Time: 0.271611
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:08:51] [V] [TRT] Tactic: -406984317033388136 Time: 0.136855
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:08:51] [V] [TRT] Tactic: -331499326992534460 Time: 0.178299
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:08:51] [V] [TRT] Tactic: -206523504474952360 Time: 0.153573
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.0948343
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(59136,1:16,336,1) -> Half(354816,1:16,2016,6) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Half(59136,59136:32,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CublasConvolution)
[11/24/2022-12:08:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Int8(236544,59136:4,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudaDepthwiseConvolution)
[11/24/2022-12:08:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1508480131241957639 Time: 0.215826
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2141154648944475104 Time: 0.213541
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3239257003214966313 Time: 0.217746
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5592640619112287921 Time: 0.201307
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:08:51] [V] [TRT] Tactic: 7621465827583909090 Time: 0.204997
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6580271968881459581 Time: 0.161001
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5576936487443445631 Time: 0.207374
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4443833619060044580 Time: 0.197582
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:08:51] [V] [TRT] Tactic: -2297737319934264721 Time: 0.165198
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1425085658556684465 Time: 0.202103
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:08:51] [V] [TRT] Tactic: -108011214168778087 Time: 0.164855
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:08:51] [V] [TRT] Tactic: -42427192380281294 Time: 0.202811
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.161001
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Int8(236544,59136:4,336,1) -> Int8(1419264,59136:4,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudaDepthwiseConvolution)
[11/24/2022-12:08:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (FusedConvActConvolution)
[11/24/2022-12:08:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:08:51] [V] [TRT] Tactic: 175853789719975416 Time: 0.0828457
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2171150287007712632 Time: 0.108494
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2234457234705232274 Time: 0.117088
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5834048089706882838 Time: 0.119982
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6299962968199310600 Time: 0.135849
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:08:51] [V] [TRT] Tactic: 6341572697076960911 Time: 0.101088
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8626990807754934295 Time: 0.081792
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:08:51] [V] [TRT] Tactic: -8498217049614706532 Time: 0.112217
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:08:51] [V] [TRT] Tactic: -7303593854972602201 Time: 0.103815
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6585664687867083638 Time: 0.138917
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0777714
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:08:51] [V] [TRT] Tactic: -683636008127039856 Time: 0.136882
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.0777714
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Int8(236544,59136:4,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:08:51] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0768571
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:08:51] [V] [TRT] Tactic: 2855900226702061782 Time: 0.132272
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3606311198834416176 Time: 0.114878
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:08:51] [V] [TRT] Tactic: 4325765560739862899 Time: 0.136334
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:08:51] [V] [TRT] Tactic: 8803458114157674373 Time: 0.108544
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:08:51] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0755383
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4431642509665791294 Time: 0.100624
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:08:51] [V] [TRT] Tactic: -4255737803793506479 Time: 0.13693
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3958182351168863467 Time: 0.101666
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:08:51] [V] [TRT] Tactic: -3111968753064955248 Time: 0.105685
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:08:51] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0851771
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:08:51] [V] [TRT] Tactic: -868495160148524802 Time: 0.113691
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.0755383
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Float(5677056,59136,336,1) ***************
[11/24/2022-12:08:51] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:08:51] [V] [TRT] Tactic: 3426497547019031858 Time: 0.176677
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:08:51] [V] [TRT] Tactic: 5104832031493112835 Time: 0.184
[11/24/2022-12:08:51] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:08:51] [V] [TRT] Tactic: -5287526117701381005 Time: 0.208704
[11/24/2022-12:08:51] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.176677
[11/24/2022-12:08:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:08:51] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Float(177408,59136:32,336,1) ***************
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2185926646498217601 Time: 0.188421
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2818014835119698671 Time: 0.159429
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:08:52] [V] [TRT] Tactic: 3721599319722771137 Time: 0.163872
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:08:52] [V] [TRT] Tactic: 4178917718361232468 Time: 0.17909
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:08:52] [V] [TRT] Tactic: 5012796702462679112 Time: 0.209179
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6556170942941957134 Time: 0.168201
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6618077155362058131 Time: 0.187566
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6969462133921577484 Time: 0.255323
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7348718297764976805 Time: 0.193134
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7869897696365535632 Time: 0.179406
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7970271430402365872 Time: 0.148905
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8584126525867982141 Time: 0.152805
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8912999970161746151 Time: 0.152786
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8893439100868426414 Time: 0.190674
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8069335661823714580 Time: 0.219831
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7988637803896331454 Time: 0.176082
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7957004747664952265 Time: 0.235159
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7904635102498369361 Time: 0.203177
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7633993163187901093 Time: 0.159131
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7606074703023778034 Time: 0.181513
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7282232519526877434 Time: 0.205975
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7007036200777870226 Time: 0.154121
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6406011580107094428 Time: 0.166843
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5603587790314027122 Time: 0.184462
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5416590980288859834 Time: 0.169518
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:08:52] [V] [TRT] Tactic: -4704615512436071369 Time: 0.153678
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3665201838779845683 Time: 0.231259
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3644377136375731441 Time: 0.182153
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3502495740607894730 Time: 0.202725
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:08:52] [V] [TRT] Tactic: -2342404147487779225 Time: 0.156535
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1610768292520086910 Time: 0.188873
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:08:52] [V] [TRT] Tactic: -621838502160440068 Time: 0.18619
[11/24/2022-12:08:52] [V] [TRT] Fastest Tactic: 7970271430402365872 Time: 0.148905
[11/24/2022-12:08:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7970271430402365872
[11/24/2022-12:08:52] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Half(177408,59136:32,336,1) ***************
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:08:52] [V] [TRT] Tactic: 424230345342282109 Time: 0.139751
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0845669
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2327398338581585326 Time: 0.129454
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2881044142075831475 Time: 0.14512
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:08:52] [V] [TRT] Tactic: 4549109251242445288 Time: 0.146437
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:08:52] [V] [TRT] Tactic: 5730376045873629665 Time: 0.175986
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7107586691882206281 Time: 0.113707
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7178538052023824067 Time: 0.129614
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0906583
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7515859573761964679 Time: 0.145573
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7563002870293617494 Time: 0.124459
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7796695344726998947 Time: 0.116126
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0893851
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8440932616520880415 Time: 0.155584
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8471142395703548718 Time: 0.110071
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:08:52] [V] [TRT] Tactic: 9072692108481390634 Time: 0.17019
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0852457
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8732118422363495199 Time: 0.131694
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8206171403568243244 Time: 0.131026
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7272221766465547628 Time: 0.139351
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6733478368603461850 Time: 0.137739
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6183300053070809929 Time: 0.104286
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6079719874915919252 Time: 0.164402
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5817829912551792981 Time: 0.134898
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5528442507917877226 Time: 0.140174
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3773982102975252832 Time: 0.126693
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3556614738549917282 Time: 0.127911
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3514726588976755320 Time: 0.173728
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:08:52] [V] [TRT] Tactic: -2649556861007671996 Time: 0.163749
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1712174008006584201 Time: 0.142917
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1008204680238783384 Time: 0.136731
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:08:52] [V] [TRT] Tactic: -50323486981480818 Time: 0.135303
[11/24/2022-12:08:52] [V] [TRT] Fastest Tactic: 2088124366723311762 Time: 0.0845669
[11/24/2022-12:08:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2088124366723311762
[11/24/2022-12:08:52] [V] [TRT] *************** Autotuning format combination: Int8(59136,59136:32,336,1) -> Int8(177408,59136:32,336,1) ***************
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudaGroupConvolution)
[11/24/2022-12:08:52] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CudaDepthwiseConvolution)
[11/24/2022-12:08:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (FusedConvActConvolution)
[11/24/2022-12:08:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_519 + node_of_520 + PWN(node_of_521) (CaskConvolution)
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:08:52] [V] [TRT] Tactic: 125145153013230687 Time: 0.139342
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:08:52] [V] [TRT] Tactic: 1583811548148740665 Time: 0.124073
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:08:52] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0848526
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:08:52] [V] [TRT] Tactic: 1797231177354918208 Time: 0.100215
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0985554
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:08:52] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0921874
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:08:52] [V] [TRT] Tactic: 3538565962642681625 Time: 0.122345
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:08:52] [V] [TRT] Tactic: 3593397928177382100 Time: 0.1424
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:08:52] [V] [TRT] Tactic: 4112572034735311841 Time: 0.129774
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:08:52] [V] [TRT] Tactic: 4610760414797216079 Time: 0.101147
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:08:52] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0674347
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:08:52] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0808891
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:08:52] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0798697
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:08:52] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0746011
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:08:52] [V] [TRT] Tactic: 5986622376339202983 Time: 0.086256
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6007888770437705057 Time: 0.105531
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0730537
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0867314
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6441948709525127755 Time: 0.152279
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6443933097134654777 Time: 0.173362
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6457435868048963632 Time: 0.105015
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0721394
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0802126
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:08:52] [V] [TRT] Tactic: 6991524515605108718 Time: 0.107497
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:08:52] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0936091
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0919314
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8173975624668590862 Time: 0.150478
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0970629
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0823337
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:08:52] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0926949
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:08:52] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0839863
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:08:52] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0947406
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0821989
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6510232214299595844 Time: 0.122057
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:08:52] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0993486
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0831543
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5562968047117507056 Time: 0.099744
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:08:52] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0782171
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:08:52] [V] [TRT] Tactic: -4455415102719506646 Time: 0.115273
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:08:52] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0724411
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:08:52] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0891886
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:08:52] [V] [TRT] Tactic: -4151617293257698859 Time: 0.186322
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3825889760337461729 Time: 0.112073
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3613322253849278738 Time: 0.138667
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:08:52] [V] [TRT] Tactic: -3288585994448820820 Time: 0.133227
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:08:52] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0956777
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:08:52] [V] [TRT] Tactic: -2432868635536396215 Time: 0.118693
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:08:52] [V] [TRT] Tactic: -2315453944962430928 Time: 0.160581
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0990171
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1549742793039499659 Time: 0.104681
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0892891
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0891634
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:08:52] [V] [TRT] Tactic: -405554772060757402 Time: 0.092128
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:08:52] [V] [TRT] Tactic: -375949437730908730 Time: 0.112688
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:08:52] [V] [TRT] Tactic: -111878368089469751 Time: 0.0709455
[11/24/2022-12:08:52] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:08:52] [V] [TRT] Tactic: -19707840769375107 Time: 0.0867543
[11/24/2022-12:08:52] [V] [TRT] Fastest Tactic: 4796956614760326119 Time: 0.0674347
[11/24/2022-12:08:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4796956614760326119
[11/24/2022-12:08:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:52] [V] [TRT] *************** Autotuning format combination: Float(5677056,59136,336,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudaDepthwiseConvolution)
[11/24/2022-12:08:52] [V] [TRT] Tactic: -1 Time: 0.360297
[11/24/2022-12:08:52] [V] [TRT] Fastest Tactic: -1 Time: 0.360297
[11/24/2022-12:08:52] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudnnConvolution)
[11/24/2022-12:08:52] [V] [TRT] Tactic: 0 Time: 0.405353
[11/24/2022-12:08:52] [V] [TRT] Tactic: 1 Time: 0.404434
[11/24/2022-12:08:52] [V] [TRT] Tactic: 2 Time: 0.398235
[11/24/2022-12:08:53] [V] [TRT] Tactic: 5 Time: 95.2963
[11/24/2022-12:08:53] [V] [TRT] Tactic: 56 Time: 0.403785
[11/24/2022-12:08:53] [V] [TRT] Tactic: 57 Time: 0.398107
[11/24/2022-12:08:53] [V] [TRT] Tactic: 58 Time: 0.398697
[11/24/2022-12:08:54] [V] [TRT] Tactic: 61 Time: 99.7968
[11/24/2022-12:08:54] [V] [TRT] Tactic: 112 Time: 0.517582
[11/24/2022-12:08:54] [V] [TRT] Tactic: 113 Time: 0.516974
[11/24/2022-12:08:54] [V] [TRT] Tactic: 114 Time: 0.50821
[11/24/2022-12:08:54] [V] [TRT] Tactic: 117 Time: 116.579
[11/24/2022-12:08:54] [V] [TRT] Fastest Tactic: 57 Time: 0.398107
[11/24/2022-12:08:54] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:54] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:08:55] [V] [TRT] Tactic: 130477820174479366 Time: 8.8993
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:08:55] [V] [TRT] Tactic: 1358952225285826925 Time: 5.16533
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:08:55] [V] [TRT] Tactic: 4549827808004681195 Time: 3.31923
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:08:55] [V] [TRT] Tactic: 5127140674766136213 Time: 4.3023
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:08:55] [V] [TRT] Tactic: 5691674214365884252 Time: 8.38139
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:08:55] [V] [TRT] Tactic: 5779835512569528575 Time: 5.89008
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:08:55] [V] [TRT] Tactic: 6053873026024413720 Time: 8.29565
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:08:55] [V] [TRT] Tactic: 6532229230713743445 Time: 9.21052
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:08:55] [V] [TRT] Tactic: 6767548733843469815 Time: 3.73675
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:08:55] [V] [TRT] Tactic: -6693149634808211969 Time: 4.52001
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:08:55] [V] [TRT] Tactic: -6313876406580483184 Time: 1.97964
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:08:55] [V] [TRT] Tactic: -4932505327461806800 Time: 8.61477
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:08:55] [V] [TRT] Tactic: -2870780723387717246 Time: 5.05279
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:08:55] [V] [TRT] Tactic: -1123676555321336786 Time: 5.91068
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:08:55] [V] [TRT] Tactic: -701551393537224327 Time: 3.3419
[11/24/2022-12:08:55] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 1.97964
[11/24/2022-12:08:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:08:55] [V] [TRT] *************** Autotuning format combination: Float(5677056,1,32256,96) -> Float(1419264,1,16128,96) ***************
[11/24/2022-12:08:55] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:08:55] [V] [TRT] Tactic: 1852818056038333088 Time: 10.3902
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:08:55] [V] [TRT] Tactic: 2137271960938803767 Time: 11.167
[11/24/2022-12:08:55] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:08:56] [V] [TRT] Tactic: 4543151729465212056 Time: 31.1839
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:08:56] [V] [TRT] Tactic: 5778138195697110002 Time: 9.24019
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:08:56] [V] [TRT] Tactic: 7098622778606028509 Time: 8.2344
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:08:56] [V] [TRT] Tactic: -9217704540809507511 Time: 10.8438
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:08:56] [V] [TRT] Tactic: -7734972403155710907 Time: 7.84672
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:08:56] [V] [TRT] Tactic: -3855385237722507463 Time: 9.39151
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:08:56] [V] [TRT] Tactic: -3360299822783115645 Time: 12.6227
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:08:56] [V] [TRT] Tactic: -2809379259463049392 Time: 9.30562
[11/24/2022-12:08:56] [V] [TRT] node_of_522 + node_of_523 + PWN(node_of_524) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:08:56] [V] [TRT] Tactic: -824800713406371346 Time: 8.85252
[11/24/2022-12:08:56] [V] [TRT] Fastest Tactic: -7734972403155710907 Time: 7.84672
[11/24/2022-12:08:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7734972403155710907
[11/24/2022-12:08:56] [V] [TRT] *************** Autotuning format combination: Float(1419264,1:4,8064,24) -> Float(354816,1:4,4032,24) ***************
[11/24/2022-12:08:56] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:56] [V] [TRT] *************** Autotuning format combination: Half(5677056,59136,336,1) -> Half(1419264,14784,168,1) ***************
[11/24/2022-12:08:56] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudnnConvolution)
[11/24/2022-12:08:56] [V] [TRT] Tactic: 0 Time: 0.209929
[11/24/2022-12:08:56] [V] [TRT] Tactic: 1 Time: 0.20907
[11/24/2022-12:08:56] [V] [TRT] Tactic: 2 Time: 0.320512
[11/24/2022-12:08:57] [V] [TRT] Tactic: 5 Time: 99.0371
[11/24/2022-12:08:57] [V] [TRT] Tactic: 56 Time: 0.209481
[11/24/2022-12:08:57] [V] [TRT] Tactic: 58 Time: 0.322752
[11/24/2022-12:08:58] [V] [TRT] Tactic: 61 Time: 101.142
[11/24/2022-12:08:58] [V] [TRT] Fastest Tactic: 1 Time: 0.20907
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Half(2838528,59136:2,336,1) -> Half(709632,14784:2,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Half(709632,1:8,4032,12) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Half(709632,1:8,4032,12) -> Half(177408,1:8,2016,12) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudaDepthwiseConvolution)
[11/24/2022-12:08:58] [V] [TRT] Tactic: -2 Time: 0.131456
[11/24/2022-12:08:58] [V] [TRT] Fastest Tactic: -2 Time: 0.131456
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Half(354816,1:16,2016,6) -> Half(88704,1:16,1008,6) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Half(177408,59136:32,336,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(1419264,59136:4,336,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudaDepthwiseConvolution)
[11/24/2022-12:08:58] [V] [TRT] Tactic: -5 Time: 0.497888
[11/24/2022-12:08:58] [V] [TRT] Fastest Tactic: -5 Time: 0.497888
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(1419264,59136:4,336,1) -> Int8(354816,14784:4,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudaDepthwiseConvolution)
[11/24/2022-12:08:58] [V] [TRT] Tactic: -3 Time: 0.0665265
[11/24/2022-12:08:58] [V] [TRT] Fastest Tactic: -3 Time: 0.0665265
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(1419264,59136:4,336,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(177408,59136:32,336,1) -> Float(1419264,14784,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(177408,59136:32,336,1) -> Float(44352,14784:32,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(177408,59136:32,336,1) -> Half(44352,14784:32,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Int8(177408,59136:32,336,1) -> Int8(44352,14784:32,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudaGroupConvolution)
[11/24/2022-12:08:58] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CudaDepthwiseConvolution)
[11/24/2022-12:08:58] [V] [TRT] Tactic: -4 Time: 0.0711131
[11/24/2022-12:08:58] [V] [TRT] Tactic: 0 Time: 0.082384
[11/24/2022-12:08:58] [V] [TRT] Tactic: 1 Time: 0.0803863
[11/24/2022-12:08:58] [V] [TRT] Tactic: 2 Time: 0.0796434
[11/24/2022-12:08:58] [V] [TRT] Tactic: 3 Time: 0.0779566
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4 Time: 0.085952
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5 Time: 0.0776686
[11/24/2022-12:08:58] [V] [TRT] Tactic: 6 Time: 0.0825783
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7 Time: 0.0839817
[11/24/2022-12:08:58] [V] [TRT] Tactic: 8 Time: 0.108633
[11/24/2022-12:08:58] [V] [TRT] Tactic: 9 Time: 0.0974514
[11/24/2022-12:08:58] [V] [TRT] Tactic: 10 Time: 0.080464
[11/24/2022-12:08:58] [V] [TRT] Tactic: 11 Time: 0.0726217
[11/24/2022-12:08:58] [V] [TRT] Tactic: 12 Time: 0.0847337
[11/24/2022-12:08:58] [V] [TRT] Tactic: 13 Time: 0.0718994
[11/24/2022-12:08:58] [V] [TRT] Tactic: 14 Time: 0.0801577
[11/24/2022-12:08:58] [V] [TRT] Tactic: 15 Time: 0.0746377
[11/24/2022-12:08:58] [V] [TRT] Tactic: 16 Time: 0.0825074
[11/24/2022-12:08:58] [V] [TRT] Tactic: 17 Time: 0.0718629
[11/24/2022-12:08:58] [V] [TRT] Tactic: 18 Time: 0.11053
[11/24/2022-12:08:58] [V] [TRT] Tactic: 19 Time: 0.0910446
[11/24/2022-12:08:58] [V] [TRT] Tactic: 20 Time: 0.0807474
[11/24/2022-12:08:58] [V] [TRT] Tactic: 21 Time: 0.0734857
[11/24/2022-12:08:58] [V] [TRT] Tactic: 22 Time: 0.0837349
[11/24/2022-12:08:58] [V] [TRT] Tactic: 23 Time: 0.068893
[11/24/2022-12:08:58] [V] [TRT] Tactic: 24 Time: 0.0804411
[11/24/2022-12:08:58] [V] [TRT] Tactic: 25 Time: 0.072992
[11/24/2022-12:08:58] [V] [TRT] Tactic: 26 Time: 0.0889257
[11/24/2022-12:08:58] [V] [TRT] Tactic: 27 Time: 0.0559482
[11/24/2022-12:08:58] [V] [TRT] Tactic: 28 Time: 0.0967474
[11/24/2022-12:08:58] [V] [TRT] Tactic: 29 Time: 0.0844709
[11/24/2022-12:08:58] [V] [TRT] Fastest Tactic: 27 Time: 0.0559482
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_522 + node_of_523 + PWN(node_of_524) (CaskConvolution)
[11/24/2022-12:08:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 27
[11/24/2022-12:08:58] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:08:58] [V] [TRT] *************** Autotuning format combination: Float(1419264,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudaDepthwiseConvolution)
[11/24/2022-12:08:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (FusedConvActConvolution)
[11/24/2022-12:08:58] [V] [TRT] Tactic: 589823 Time: 0.321472
[11/24/2022-12:08:58] [V] [TRT] Tactic: 655359 Time: 0.284631
[11/24/2022-12:08:58] [V] [TRT] Tactic: 786431 Time: 0.178135
[11/24/2022-12:08:58] [V] [TRT] Tactic: 851967 Time: 0.320763
[11/24/2022-12:08:58] [V] [TRT] Tactic: 1179647 Time: 0.183858
[11/24/2022-12:08:58] [V] [TRT] Tactic: 1638399 Time: 0.179511
[11/24/2022-12:08:58] [V] [TRT] Tactic: 2097151 Time: 0.16011
[11/24/2022-12:08:58] [V] [TRT] Tactic: 3538943 Time: 0.181495
[11/24/2022-12:08:58] [V] [TRT] Tactic: 3932159 Time: 0.285298
[11/24/2022-12:08:58] [V] [TRT] Tactic: 3997695 Time: 0.165911
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4194303 Time: 0.176498
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4259839 Time: 0.15061
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4587519 Time: 0.159141
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4653055 Time: 0.179383
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4915199 Time: 0.163675
[11/24/2022-12:08:58] [V] [TRT] Tactic: 4980735 Time: 0.187017
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5177343 Time: 0.186853
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5242879 Time: 0.193586
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5373951 Time: 0.215333
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5570559 Time: 0.279415
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5767167 Time: 0.367104
[11/24/2022-12:08:58] [V] [TRT] Tactic: 5898239 Time: 0.176261
[11/24/2022-12:08:58] [V] [TRT] Tactic: 6225919 Time: 0.17877
[11/24/2022-12:08:58] [V] [TRT] Tactic: 6291455 Time: 0.184183
[11/24/2022-12:08:58] [V] [TRT] Tactic: 6815743 Time: 0.210962
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7012351 Time: 0.159886
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7077887 Time: 0.172133
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7143423 Time: 0.269458
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7208959 Time: 0.196279
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7340031 Time: 0.185659
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7536639 Time: 0.364928
[11/24/2022-12:08:58] [V] [TRT] Tactic: 7733247 Time: 0.176526
[11/24/2022-12:08:58] [V] [TRT] Tactic: 8191999 Time: 0.206359
[11/24/2022-12:08:58] [V] [TRT] Tactic: 8716287 Time: 0.211314
[11/24/2022-12:08:58] [V] [TRT] Tactic: 9109503 Time: 0.160489
[11/24/2022-12:08:58] [V] [TRT] Tactic: 9568255 Time: 0.164023
[11/24/2022-12:08:58] [V] [TRT] Tactic: 10354687 Time: 0.161714
[11/24/2022-12:08:58] [V] [TRT] Tactic: 10747903 Time: 0.173207
[11/24/2022-12:08:58] [V] [TRT] Fastest Tactic: 4259839 Time: 0.15061
[11/24/2022-12:08:58] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudnnConvolution)
[11/24/2022-12:08:58] [V] [TRT] Tactic: 0 Time: 0.0842811
[11/24/2022-12:08:58] [V] [TRT] Tactic: 1 Time: 0.0666011
[11/24/2022-12:08:58] [V] [TRT] Tactic: 2 Time: 0.177499
[11/24/2022-12:08:59] [V] [TRT] Tactic: 4 Time: 24.3236
[11/24/2022-12:08:59] [V] [TRT] Tactic: 5 Time: 0.370117
[11/24/2022-12:08:59] [V] [TRT] Tactic: 56 Time: 0.0845623
[11/24/2022-12:08:59] [V] [TRT] Tactic: 57 Time: 0.0639589
[11/24/2022-12:08:59] [V] [TRT] Tactic: 58 Time: 0.179502
[11/24/2022-12:08:59] [V] [TRT] Tactic: 60 Time: 24.3308
[11/24/2022-12:08:59] [V] [TRT] Tactic: 61 Time: 0.363305
[11/24/2022-12:08:59] [V] [TRT] Tactic: 112 Time: 0.0837349
[11/24/2022-12:08:59] [V] [TRT] Tactic: 113 Time: 0.0777669
[11/24/2022-12:08:59] [V] [TRT] Tactic: 114 Time: 0.175643
[11/24/2022-12:09:00] [V] [TRT] Tactic: 116 Time: 24.5039
[11/24/2022-12:09:00] [V] [TRT] Tactic: 117 Time: 0.372718
[11/24/2022-12:09:00] [V] [TRT] Fastest Tactic: 57 Time: 0.0639589
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:00] [V] [TRT] Tactic: 621442388677115936 Time: 0.172837
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:00] [V] [TRT] Tactic: 697756878388249475 Time: 0.0866766
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:00] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0918583
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:00] [V] [TRT] Tactic: 1327459216264546184 Time: 0.100158
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:00] [V] [TRT] Tactic: 2290218393647758202 Time: 0.102866
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:00] [V] [TRT] Tactic: 2310520233542099555 Time: 0.175479
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:00] [V] [TRT] Tactic: 3377996665278764661 Time: 0.375255
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4032904638566464623 Time: 0.105109
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0909646
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4918658762935651592 Time: 0.167333
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5779835512569528575 Time: 0.153161
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5837905844602864231 Time: 0.129241
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6166883504066133838 Time: 0.143744
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0933371
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6500866402607985231 Time: 0.120192
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0828091
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6868013466259746979 Time: 0.140421
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6901214267543238617 Time: 0.110978
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:00] [V] [TRT] Tactic: 8048119769507926928 Time: 0.171831
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:00] [V] [TRT] Tactic: 9151672657204310840 Time: 0.100923
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:00] [V] [TRT] Tactic: -8877086111929938764 Time: 0.115499
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:00] [V] [TRT] Tactic: -8766093103475083267 Time: 0.103867
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:00] [V] [TRT] Tactic: -8198656951359619379 Time: 0.106759
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:00] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0577707
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:00] [V] [TRT] Tactic: -7145578994937510651 Time: 0.189751
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:00] [V] [TRT] Tactic: -7070045993088702524 Time: 0.355127
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:00] [V] [TRT] Tactic: -6622064180404051845 Time: 0.095184
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:00] [V] [TRT] Tactic: -6313876406580483184 Time: 0.061664
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:00] [V] [TRT] Tactic: -6273689210331812572 Time: 0.151214
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:00] [V] [TRT] Tactic: -4562045946847239058 Time: 0.196357
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:00] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0850149
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:00] [V] [TRT] Tactic: -2777237991111865351 Time: 0.179232
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1918478037390720253 Time: 0.110917
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1349585930542925704 Time: 0.129943
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1123676555321336786 Time: 0.154661
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:00] [V] [TRT] Tactic: -701551393537224327 Time: 0.0926171
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:00] [V] [TRT] Tactic: -3258434593395023 Time: 0.183342
[11/24/2022-12:09:00] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0577707
[11/24/2022-12:09:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:09:00] [V] [TRT] *************** Autotuning format combination: Float(1419264,1,16128,96) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:00] [V] [TRT] Tactic: 1162498931361159915 Time: 0.150299
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:00] [V] [TRT] Tactic: 1663866669559596164 Time: 0.142638
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:00] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0914789
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:00] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0879977
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0663177
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0662461
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0923771
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5778138195697110003 Time: 0.144434
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0860617
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:00] [V] [TRT] Tactic: 8918020581761223752 Time: 0.140279
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:00] [V] [TRT] Tactic: -8031737312007363273 Time: 0.084576
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:00] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0877737
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:00] [V] [TRT] Tactic: -4896615592193611463 Time: 0.09856
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:00] [V] [TRT] Tactic: -4056705536979434560 Time: 0.147552
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:00] [V] [TRT] Tactic: -4035591156787122265 Time: 0.064963
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:00] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0871954
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:00] [V] [TRT] Tactic: -2809379259463049391 Time: 0.145998
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1985235291706575900 Time: 0.13907
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:00] [V] [TRT] Tactic: -504296718212024303 Time: 0.141061
[11/24/2022-12:09:00] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.064963
[11/24/2022-12:09:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:09:00] [V] [TRT] *************** Autotuning format combination: Float(354816,1:4,4032,24) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:00] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0625722
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:00] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0580891
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:00] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0556038
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5108195418077987197 Time: 0.071792
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5380043773350002416 Time: 0.06
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0556602
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0740686
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0698804
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6571171993204510025 Time: 0.101378
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:00] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0866857
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:00] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0670202
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:00] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0642194
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:00] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0618194
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:00] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0771291
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:00] [V] [TRT] Tactic: -6073218138311523634 Time: 0.071136
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:00] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0841989
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:00] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0722103
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1450865838092804082 Time: 0.103246
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0678141
[11/24/2022-12:09:00] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:00] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0603992
[11/24/2022-12:09:00] [V] [TRT] Fastest Tactic: 3119404851233737725 Time: 0.0556038
[11/24/2022-12:09:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3119404851233737725
[11/24/2022-12:09:00] [V] [TRT] *************** Autotuning format combination: Half(1419264,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:09:00] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudnnConvolution)
[11/24/2022-12:09:00] [V] [TRT] Tactic: 0 Time: 0.0747703
[11/24/2022-12:09:00] [V] [TRT] Tactic: 1 Time: 0.0739086
[11/24/2022-12:09:00] [V] [TRT] Tactic: 2 Time: 0.257714
[11/24/2022-12:09:00] [V] [TRT] Tactic: 4 Time: 24.241
[11/24/2022-12:09:00] [V] [TRT] Tactic: 5 Time: 0.364014
[11/24/2022-12:09:00] [V] [TRT] Tactic: 56 Time: 0.0740663
[11/24/2022-12:09:00] [V] [TRT] Tactic: 58 Time: 0.257746
[11/24/2022-12:09:01] [V] [TRT] Tactic: 60 Time: 24.3364
[11/24/2022-12:09:01] [V] [TRT] Tactic: 61 Time: 0.363227
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: 1 Time: 0.0739086
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Half(709632,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Half(709632,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (FusedConvActConvolution)
[11/24/2022-12:09:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Half(177408,1:8,2016,12) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Half(177408,1:8,2016,12) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudaDepthwiseConvolution)
[11/24/2022-12:09:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:01] [V] [TRT] Tactic: 254850674756030979 Time: 0.0409451
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0449909
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0302939
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0420183
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1362727228442059924 Time: 0.021858
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0820457
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0487238
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0314359
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0857029
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1899296423087490472 Time: 0.051011
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2238656696610018305 Time: 0.051712
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0365326
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0591116
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0705097
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2968605903460894194 Time: 0.032224
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0269531
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0175868
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0539855
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0433966
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0412766
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0288119
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0693973
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0160528
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0224888
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0324142
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4528997467275241200 Time: 0.01828
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0329499
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0428971
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0588526
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0357577
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0222596
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5059676457552313631 Time: 0.043496
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0413223
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0375131
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0492861
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0382926
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0502522
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0430629
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0556663
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0529128
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0333175
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6724319788728799540 Time: 0.087888
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0456651
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0234136
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0304411
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8095507026323593899 Time: 0.030795
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0489646
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0477623
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0351735
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0244465
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0223353
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:01] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0159385
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:01] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0380686
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0655177
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0395051
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0329655
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8131857373260504832 Time: 0.02656
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0675764
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0350345
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0582309
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0294674
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0752823
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0434583
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0365029
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0160706
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0325787
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0525882
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0460754
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0423166
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0310455
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0837417
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4548822885169694805 Time: 0.045848
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0298441
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0434206
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0424789
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0708389
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0852709
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0368663
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0270491
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0261745
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0464389
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3234716536615144018 Time: 0.034261
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0406023
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0568335
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0232398
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0527055
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0334281
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0457783
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0490682
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0254415
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0247048
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0308279
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0309458
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1242202084391243207 Time: 0.06704
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0621105
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0410011
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:01] [V] [TRT] Tactic: -406984317033388136 Time: 0.0401771
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:01] [V] [TRT] Tactic: -331499326992534460 Time: 0.0288037
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:01] [V] [TRT] Tactic: -206523504474952360 Time: 0.04748
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.0159385
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Half(88704,1:16,1008,6) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Half(44352,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CublasConvolution)
[11/24/2022-12:09:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudaDepthwiseConvolution)
[11/24/2022-12:09:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0695192
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0693486
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0700526
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0274042
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0385383
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0235135
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0394983
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0272709
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0248777
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0287552
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:01] [V] [TRT] Tactic: -108011214168778087 Time: 0.0241973
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:01] [V] [TRT] Tactic: -42427192380281294 Time: 0.03736
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0235135
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudaDepthwiseConvolution)
[11/24/2022-12:09:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (FusedConvActConvolution)
[11/24/2022-12:09:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:01] [V] [TRT] Tactic: 175853789719975416 Time: 0.0203789
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2171150287007712632 Time: 0.022494
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0312366
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0315849
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0539352
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0213427
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0202743
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0305765
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0223451
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6585664687867083638 Time: 0.055549
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0201411
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:01] [V] [TRT] Tactic: -683636008127039856 Time: 0.0548053
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.0201411
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0202617
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0525288
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0309778
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0539017
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0294053
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0198429
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0205793
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0540556
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0219644
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0224268
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0205218
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:01] [V] [TRT] Tactic: -868495160148524802 Time: 0.0309083
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.0198429
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(44352,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0213068
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0236976
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0236715
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0213068
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(44352,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0239299
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0202029
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0218547
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0242301
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0416537
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6556170942941957134 Time: 0.035595
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0197063
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0467851
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0250956
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0200091
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7970271430402365872 Time: 0.027603
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0193286
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0301166
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0252678
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0305189
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0348928
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0433269
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0384526
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0201931
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0270088
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0414457
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0187429
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0214955
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0246362
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0347721
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4704615512436071369 Time: 0.023554
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0334985
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0243893
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0266705
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0267825
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1610768292520086910 Time: 0.025725
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:01] [V] [TRT] Tactic: -621838502160440068 Time: 0.0253989
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.0187429
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(44352,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:01] [V] [TRT] Tactic: 424230345342282109 Time: 0.0224862
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0160229
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0354176
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0208503
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0395543
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0249432
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0287168
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0353225
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0165552
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0391269
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0300955
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0285961
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0262301
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0164937
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0181217
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:01] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0232346
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0244571
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0150555
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0189954
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0227252
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0225378
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0268853
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0457017
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5817829912551792981 Time: 0.021696
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5528442507917877226 Time: 0.015937
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0202834
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0352064
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0488731
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0178164
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1712174008006584201 Time: 0.03956
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0221375
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:01] [V] [TRT] Tactic: -50323486981480818 Time: 0.0223282
[11/24/2022-12:09:01] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.0150555
[11/24/2022-12:09:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:09:01] [V] [TRT] *************** Autotuning format combination: Int8(44352,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudaGroupConvolution)
[11/24/2022-12:09:01] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CudaDepthwiseConvolution)
[11/24/2022-12:09:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (FusedConvActConvolution)
[11/24/2022-12:09:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:01] [V] [TRT] --------------- Timing Runner: node_of_525 + node_of_526 (CaskConvolution)
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:01] [V] [TRT] Tactic: 125145153013230687 Time: 0.0412869
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0372251
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0264114
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:01] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0138689
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:01] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0180651
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0268358
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0204558
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:01] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0244701
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0169803
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0287543
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:01] [V] [TRT] Tactic: 4796956614760326119 Time: 0.022242
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0160036
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5443897483205284103 Time: 0.024512
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0160787
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:01] [V] [TRT] Tactic: 5986622376339202983 Time: 0.026688
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0287086
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0224842
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6433368103202497147 Time: 0.016543
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6441948709525127755 Time: 0.024864
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0477013
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0303049
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6793988781414507278 Time: 0.024512
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0266667
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:01] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0331593
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:01] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0175858
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0266514
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0458869
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8234775147403903473 Time: 0.028949
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0245867
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:01] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0268305
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:01] [V] [TRT] Tactic: -8638624340850784688 Time: 0.026608
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:01] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0286501
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0160127
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0158295
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:01] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0266171
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0252427
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0266583
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:01] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0246636
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0198257
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0248541
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4182501876984672402 Time: 0.026669
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:01] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0511924
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0139832
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0176894
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:01] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0392731
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0138556
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0356498
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:01] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0497737
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:01] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0309285
[11/24/2022-12:09:01] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:02] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0287808
[11/24/2022-12:09:02] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:02] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0287607
[11/24/2022-12:09:02] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:02] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0135958
[11/24/2022-12:09:02] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:02] [V] [TRT] Tactic: -405554772060757402 Time: 0.0179166
[11/24/2022-12:09:02] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:02] [V] [TRT] Tactic: -375949437730908730 Time: 0.0200549
[11/24/2022-12:09:02] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:02] [V] [TRT] Tactic: -111878368089469751 Time: 0.0247497
[11/24/2022-12:09:02] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:02] [V] [TRT] Tactic: -19707840769375107 Time: 0.0124537
[11/24/2022-12:09:02] [V] [TRT] Fastest Tactic: -19707840769375107 Time: 0.0124537
[11/24/2022-12:09:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -19707840769375107
[11/24/2022-12:09:02] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:02] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:02] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudaDepthwiseConvolution)
[11/24/2022-12:09:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:02] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (FusedConvActConvolution)
[11/24/2022-12:09:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:02] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudnnConvolution)
[11/24/2022-12:09:02] [V] [TRT] Tactic: 0 Time: 0.370071
[11/24/2022-12:09:02] [V] [TRT] Tactic: 1 Time: 0.305449
[11/24/2022-12:09:02] [V] [TRT] Tactic: 2 Time: 0.398025
[11/24/2022-12:09:02] [V] [TRT] Tactic: 4 Time: 45.2364
[11/24/2022-12:09:02] [V] [TRT] Tactic: 5 Time: 0.633358
[11/24/2022-12:09:02] [V] [TRT] Tactic: 56 Time: 0.3752
[11/24/2022-12:09:02] [V] [TRT] Tactic: 57 Time: 0.307543
[11/24/2022-12:09:02] [V] [TRT] Tactic: 58 Time: 0.40005
[11/24/2022-12:09:03] [V] [TRT] Tactic: 60 Time: 45.0349
[11/24/2022-12:09:03] [V] [TRT] Tactic: 61 Time: 0.633093
[11/24/2022-12:09:03] [V] [TRT] Tactic: 112 Time: 0.373746
[11/24/2022-12:09:03] [V] [TRT] Tactic: 113 Time: 0.318149
[11/24/2022-12:09:03] [V] [TRT] Tactic: 114 Time: 0.395337
[11/24/2022-12:09:04] [V] [TRT] Tactic: 116 Time: 45.2289
[11/24/2022-12:09:04] [V] [TRT] Tactic: 117 Time: 0.634254
[11/24/2022-12:09:04] [V] [TRT] Fastest Tactic: 1 Time: 0.305449
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:04] [V] [TRT] Tactic: 621442388677115936 Time: 0.271707
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:04] [V] [TRT] Tactic: 697756878388249475 Time: 0.279214
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:04] [V] [TRT] Tactic: 1159272950022995759 Time: 0.172686
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:04] [V] [TRT] Tactic: 1327459216264546184 Time: 0.341371
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:04] [V] [TRT] Tactic: 2290218393647758202 Time: 0.14853
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:04] [V] [TRT] Tactic: 2310520233542099555 Time: 0.143136
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:04] [V] [TRT] Tactic: 3377996665278764661 Time: 0.200681
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:04] [V] [TRT] Tactic: 4032904638566464623 Time: 0.205454
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:04] [V] [TRT] Tactic: 4549827808004681195 Time: 0.109877
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:04] [V] [TRT] Tactic: 4918658762935651592 Time: 0.359127
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:04] [V] [TRT] Tactic: 5779835512569528575 Time: 0.138551
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:04] [V] [TRT] Tactic: 5837905844602864231 Time: 0.175058
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6166883504066133838 Time: 0.205029
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6210049212073459059 Time: 0.157888
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6500866402607985231 Time: 0.232873
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6723161876874263939 Time: 0.134352
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6868013466259746979 Time: 0.216631
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6901214267543238617 Time: 0.24448
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:04] [V] [TRT] Tactic: 8048119769507926928 Time: 0.253746
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:04] [V] [TRT] Tactic: 9151672657204310840 Time: 0.138834
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:04] [V] [TRT] Tactic: -8877086111929938764 Time: 0.155607
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:04] [V] [TRT] Tactic: -8766093103475083267 Time: 0.150848
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:04] [V] [TRT] Tactic: -8198656951359619379 Time: 0.148878
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:04] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0921326
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:04] [V] [TRT] Tactic: -7145578994937510651 Time: 0.189605
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:04] [V] [TRT] Tactic: -7070045993088702524 Time: 0.188827
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:04] [V] [TRT] Tactic: -6622064180404051845 Time: 0.129415
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:04] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0913097
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:04] [V] [TRT] Tactic: -6273689210331812572 Time: 0.138475
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:04] [V] [TRT] Tactic: -4562045946847239058 Time: 0.195145
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:04] [V] [TRT] Tactic: -4337126844824617177 Time: 0.109243
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:04] [V] [TRT] Tactic: -2777237991111865351 Time: 0.148361
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1918478037390720253 Time: 0.157042
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1349585930542925704 Time: 0.295703
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1123676555321336786 Time: 0.140953
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:04] [V] [TRT] Tactic: -701551393537224327 Time: 0.111897
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:04] [V] [TRT] Tactic: -3258434593395023 Time: 0.183877
[11/24/2022-12:09:04] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 0.0913097
[11/24/2022-12:09:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6313876406580483184
[11/24/2022-12:09:04] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:04] [V] [TRT] Tactic: 1162498931361159915 Time: 0.146478
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:04] [V] [TRT] Tactic: 1663866669559596164 Time: 0.120565
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:04] [V] [TRT] Tactic: 2860655430572478466 Time: 0.137979
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:04] [V] [TRT] Tactic: 3887292144336338310 Time: 0.118469
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:04] [V] [TRT] Tactic: 4474630279712975759 Time: 0.170821
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:04] [V] [TRT] Tactic: 4479823862704990365 Time: 0.171936
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:04] [V] [TRT] Tactic: 4696204239951173149 Time: 0.137815
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:04] [V] [TRT] Tactic: 5778138195697110003 Time: 0.122626
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6185707384100198445 Time: 0.11653
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:04] [V] [TRT] Tactic: 8918020581761223752 Time: 0.12208
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:04] [V] [TRT] Tactic: -8031737312007363273 Time: 0.111349
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:04] [V] [TRT] Tactic: -5905193483742532701 Time: 0.136313
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:04] [V] [TRT] Tactic: -4896615592193611463 Time: 0.130677
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:04] [V] [TRT] Tactic: -4056705536979434560 Time: 0.141001
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:04] [V] [TRT] Tactic: -4035591156787122265 Time: 0.167954
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:04] [V] [TRT] Tactic: -3071763921328736248 Time: 0.112709
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:04] [V] [TRT] Tactic: -2809379259463049391 Time: 0.123618
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1985235291706575900 Time: 0.120594
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:04] [V] [TRT] Tactic: -504296718212024303 Time: 0.121669
[11/24/2022-12:09:04] [V] [TRT] Fastest Tactic: -8031737312007363273 Time: 0.111349
[11/24/2022-12:09:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8031737312007363273
[11/24/2022-12:09:04] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:04] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0749577
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:04] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0898766
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:04] [V] [TRT] Tactic: 3119404851233737725 Time: 0.101872
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:04] [V] [TRT] Tactic: 5108195418077987197 Time: 0.154688
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:04] [V] [TRT] Tactic: 5380043773350002416 Time: 0.114953
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:04] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0831634
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6031243482516294286 Time: 0.109465
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0889989
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0906446
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:04] [V] [TRT] Tactic: 6832381412128253616 Time: 0.134347
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:04] [V] [TRT] Tactic: 7058864664858220889 Time: 0.129355
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:04] [V] [TRT] Tactic: -8853476220903838035 Time: 0.192933
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:04] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0738971
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:04] [V] [TRT] Tactic: -6407735577805887428 Time: 0.167867
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:04] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0926354
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:04] [V] [TRT] Tactic: -5033173285090644307 Time: 0.13283
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:04] [V] [TRT] Tactic: -5010594849215755610 Time: 0.108025
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0924411
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1366318165940453381 Time: 0.213586
[11/24/2022-12:09:04] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:04] [V] [TRT] Tactic: -1138876066247138089 Time: 0.112674
[11/24/2022-12:09:04] [V] [TRT] Fastest Tactic: -7067026478815706014 Time: 0.0738971
[11/24/2022-12:09:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7067026478815706014
[11/24/2022-12:09:04] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:09:04] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudnnConvolution)
[11/24/2022-12:09:04] [V] [TRT] Tactic: 0 Time: 0.269262
[11/24/2022-12:09:04] [V] [TRT] Tactic: 1 Time: 0.259511
[11/24/2022-12:09:04] [V] [TRT] Tactic: 2 Time: 0.341559
[11/24/2022-12:09:05] [V] [TRT] Tactic: 4 Time: 45.0749
[11/24/2022-12:09:05] [V] [TRT] Tactic: 5 Time: 0.583328
[11/24/2022-12:09:05] [V] [TRT] Tactic: 56 Time: 0.276526
[11/24/2022-12:09:05] [V] [TRT] Tactic: 58 Time: 0.330619
[11/24/2022-12:09:06] [V] [TRT] Tactic: 60 Time: 44.7498
[11/24/2022-12:09:06] [V] [TRT] Tactic: 61 Time: 0.58064
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: 1 Time: 0.259511
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (FusedConvActConvolution)
[11/24/2022-12:09:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0698255
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3891805945559659536 Time: 0.133723
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0730171
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0667627
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0661547
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0599421
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4884039206922900293 Time: 0.093552
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0669821
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1546027692247304867 Time: 0.132805
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0599421
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudaDepthwiseConvolution)
[11/24/2022-12:09:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:06] [V] [TRT] Tactic: 254850674756030979 Time: 0.076176
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0779337
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0700587
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0752091
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0558674
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1576319725282257846 Time: 0.157769
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1832046141070096030 Time: 0.117179
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0785166
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0805806
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1899296423087490472 Time: 0.119033
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0966994
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0657646
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0575924
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2657157263811141609 Time: 0.19504
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0791109
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0977166
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0544
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0981989
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0809394
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3704534001553878387 Time: 0.07328
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0761829
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4278315135102886928 Time: 0.137145
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0521158
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0548968
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0593265
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0459783
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0839634
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0767086
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0567665
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4802447371470387646 Time: 0.084528
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0523291
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0767909
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5070322914990170527 Time: 0.07456
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5205510332404400949 Time: 0.063933
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0805006
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0868274
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0913371
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0679025
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0973349
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6468794451065529747 Time: 0.13019
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0624
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0835863
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6859477213531075460 Time: 0.117333
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7216571380637776659 Time: 0.057149
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0756229
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0775909
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8101703987960976805 Time: 0.127122
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8170606396342855895 Time: 0.124263
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0861806
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0604968
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0565013
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:06] [V] [TRT] Tactic: -9203179519031456182 Time: 0.047712
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:06] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0850926
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8604374562669615024 Time: 0.182281
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0744137
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0592472
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0610011
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7410012245391920273 Time: 0.192549
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0648701
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7089118800560870395 Time: 0.163086
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0530347
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6356316196810535311 Time: 0.212183
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6063766379489217211 Time: 0.111831
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0656
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0499596
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0809737
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5161596964442251102 Time: 0.100354
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0916754
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0781143
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4950923835688973492 Time: 0.079248
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4796511246675321840 Time: 0.163415
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4548822885169694805 Time: 0.121867
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0748069
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4293222705763522367 Time: 0.108352
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0801897
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4021926646879732549 Time: 0.141605
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3987638434926559037 Time: 0.167159
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0887931
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0579779
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0605394
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3601464762214218301 Time: 0.115922
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0624579
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0647192
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0986103
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0407337
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0940046
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0821006
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2032577876140256150 Time: 0.119143
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0875131
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0612175
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0933097
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0758263
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0519573
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1242202084391243207 Time: 0.132066
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1099247066487349374 Time: 0.172105
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1038291877007553549 Time: 0.10616
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:06] [V] [TRT] Tactic: -406984317033388136 Time: 0.0721829
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:06] [V] [TRT] Tactic: -331499326992534460 Time: 0.0724594
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:06] [V] [TRT] Tactic: -206523504474952360 Time: 0.0816023
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: -2878731503146438856 Time: 0.0407337
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2878731503146438856
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CublasConvolution)
[11/24/2022-12:09:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudaDepthwiseConvolution)
[11/24/2022-12:09:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1508480131241957639 Time: 0.113115
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2141154648944475104 Time: 0.111166
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3239257003214966313 Time: 0.114117
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5592640619112287921 Time: 0.075024
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7621465827583909090 Time: 0.081328
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0672533
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0822034
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0738697
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0689189
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0780914
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:06] [V] [TRT] Tactic: -108011214168778087 Time: 0.0696975
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:06] [V] [TRT] Tactic: -42427192380281294 Time: 0.08184
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0672533
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudaDepthwiseConvolution)
[11/24/2022-12:09:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (FusedConvActConvolution)
[11/24/2022-12:09:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:06] [V] [TRT] Tactic: 175853789719975416 Time: 0.0438217
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0501272
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0462023
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0473634
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0629867
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0464983
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0425943
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0446949
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7303593854972602201 Time: 0.047619
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0644571
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3326139578711341011 Time: 0.041104
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:06] [V] [TRT] Tactic: -683636008127039856 Time: 0.0637379
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.041104
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0417086
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0627794
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0456206
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0636282
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0437966
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0400389
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0450366
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0647086
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0462126
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0483291
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0428937
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:06] [V] [TRT] Tactic: -868495160148524802 Time: 0.0448137
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.0400389
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0775154
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0795154
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0920914
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0775154
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(73920,14784:32,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2185926646498217601 Time: 0.083344
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0713737
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0751383
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0761394
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5012796702462679112 Time: 0.102551
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0878377
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0850674
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6969462133921577484 Time: 0.102423
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0799543
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0816274
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0759749
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0696823
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0790789
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0847749
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0912823
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0861211
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0980389
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7904635102498369361 Time: 0.101998
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0705981
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7606074703023778034 Time: 0.079392
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7282232519526877434 Time: 0.103367
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0710674
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6406011580107094428 Time: 0.073072
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0813394
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5416590980288859834 Time: 0.087456
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4704615512436071369 Time: 0.078976
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0947863
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0791223
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0844046
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0816526
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1610768292520086910 Time: 0.080768
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:06] [V] [TRT] Tactic: -621838502160440068 Time: 0.0797577
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: 8584126525867982141 Time: 0.0696823
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8584126525867982141
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:06] [V] [TRT] Tactic: 424230345342282109 Time: 0.0491063
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0378766
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2327398338581585326 Time: 0.060224
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0638598
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0677928
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0654171
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0586941
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0565821
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0412606
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0672701
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0578027
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0605425
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0462709
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8440932616520880415 Time: 0.069312
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8471142395703548718 Time: 0.049536
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:06] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0601752
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0451291
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0556069
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0591238
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0483733
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0473337
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0565242
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0548297
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0462869
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0598248
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0547992
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0568152
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0600259
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2649556861007671996 Time: 0.068771
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0653745
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0456789
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:06] [V] [TRT] Tactic: -50323486981480818 Time: 0.0477242
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: 2088124366723311762 Time: 0.0378766
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2088124366723311762
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudaGroupConvolution)
[11/24/2022-12:09:06] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CudaDepthwiseConvolution)
[11/24/2022-12:09:06] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (FusedConvActConvolution)
[11/24/2022-12:09:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_527 + node_of_528 + PWN(node_of_529) (CaskConvolution)
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:06] [V] [TRT] Tactic: 125145153013230687 Time: 0.0361314
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0316069
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0393966
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0372709
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2756291002030759362 Time: 0.034101
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0385669
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0430914
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:06] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0501989
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4112572034735311841 Time: 0.047552
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0423509
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:06] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0315118
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0304466
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0363383
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0288832
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:06] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0381257
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0449006
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0326208
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0319835
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0548404
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6443933097134654777 Time: 0.041616
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6457435868048963632 Time: 0.045288
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0344274
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0377669
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:06] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0308617
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:06] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0334062
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0398103
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0392583
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0435017
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0370503
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:06] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0396103
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:06] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0393977
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:06] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0404057
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0306624
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0436571
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:06] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0405474
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0373223
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0406457
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:06] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0363714
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0384846
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0373006
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0402046
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:06] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0442343
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0392434
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0522027
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:06] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0340983
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0370971
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0305134
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:06] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0417017
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0270278
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0448423
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0433897
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0331584
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:06] [V] [TRT] Tactic: -405554772060757402 Time: 0.0343515
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:06] [V] [TRT] Tactic: -375949437730908730 Time: 0.0380777
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:06] [V] [TRT] Tactic: -111878368089469751 Time: 0.0354752
[11/24/2022-12:09:06] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:06] [V] [TRT] Tactic: -19707840769375107 Time: 0.0319141
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: -1916483171117495388 Time: 0.0270278
[11/24/2022-12:09:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1916483171117495388
[11/24/2022-12:09:06] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:06] [V] [TRT] *************** Autotuning format combination: Float(2128896,14784,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudaDepthwiseConvolution)
[11/24/2022-12:09:06] [V] [TRT] Tactic: -1 Time: 0.180955
[11/24/2022-12:09:06] [V] [TRT] Fastest Tactic: -1 Time: 0.180955
[11/24/2022-12:09:06] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudnnConvolution)
[11/24/2022-12:09:06] [V] [TRT] Tactic: 0 Time: 0.398606
[11/24/2022-12:09:06] [V] [TRT] Tactic: 1 Time: 0.402359
[11/24/2022-12:09:06] [V] [TRT] Tactic: 2 Time: 0.504133
[11/24/2022-12:09:07] [V] [TRT] Tactic: 4 Time: 55.7747
[11/24/2022-12:09:07] [V] [TRT] Tactic: 5 Time: 32.6456
[11/24/2022-12:09:07] [V] [TRT] Tactic: 6 Time: 4.54888
[11/24/2022-12:09:07] [V] [TRT] Tactic: 56 Time: 0.405998
[11/24/2022-12:09:07] [V] [TRT] Tactic: 57 Time: 0.403739
[11/24/2022-12:09:07] [V] [TRT] Tactic: 58 Time: 0.505454
[11/24/2022-12:09:08] [V] [TRT] Tactic: 60 Time: 55.8014
[11/24/2022-12:09:08] [V] [TRT] Tactic: 61 Time: 32.8029
[11/24/2022-12:09:08] [V] [TRT] Tactic: 62 Time: 4.55766
[11/24/2022-12:09:08] [V] [TRT] Tactic: 112 Time: 0.403607
[11/24/2022-12:09:08] [V] [TRT] Tactic: 113 Time: 0.402816
[11/24/2022-12:09:08] [V] [TRT] Tactic: 114 Time: 0.505637
[11/24/2022-12:09:08] [V] [TRT] Tactic: 116 Time: 56.2527
[11/24/2022-12:09:09] [V] [TRT] Tactic: 117 Time: 34.7982
[11/24/2022-12:09:09] [V] [TRT] Tactic: 118 Time: 4.66581
[11/24/2022-12:09:09] [V] [TRT] Fastest Tactic: 0 Time: 0.398606
[11/24/2022-12:09:09] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:09:09] [V] [TRT] Tactic: 130477820174479366 Time: 13.2834
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:09:09] [V] [TRT] Tactic: 1358952225285826925 Time: 7.63689
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:09] [V] [TRT] Tactic: 4549827808004681195 Time: 4.84983
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:09:09] [V] [TRT] Tactic: 5127140674766136213 Time: 6.4041
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:09:09] [V] [TRT] Tactic: 5691674214365884252 Time: 12.4099
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:09] [V] [TRT] Tactic: 5779835512569528575 Time: 8.78291
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:09:09] [V] [TRT] Tactic: 6053873026024413720 Time: 12.3311
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:09:09] [V] [TRT] Tactic: 6532229230713743445 Time: 13.7388
[11/24/2022-12:09:09] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:09:10] [V] [TRT] Tactic: 6767548733843469815 Time: 5.48531
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:09:10] [V] [TRT] Tactic: -7777264329408437990 Time: 5.34969
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:09:10] [V] [TRT] Tactic: -6693149634808211969 Time: 6.74981
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:10] [V] [TRT] Tactic: -6313876406580483184 Time: 2.77743
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:09:10] [V] [TRT] Tactic: -4932505327461806800 Time: 12.7427
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:09:10] [V] [TRT] Tactic: -2870780723387717246 Time: 7.50789
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:10] [V] [TRT] Tactic: -1123676555321336786 Time: 8.86217
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:10] [V] [TRT] Tactic: -701551393537224327 Time: 4.94151
[11/24/2022-12:09:10] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 2.77743
[11/24/2022-12:09:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:09:10] [V] [TRT] *************** Autotuning format combination: Float(2128896,1,24192,144) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:09:10] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:09:10] [V] [TRT] Tactic: 1852818056038333088 Time: 11.6539
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:09:10] [V] [TRT] Tactic: 2137271960938803767 Time: 10.7286
[11/24/2022-12:09:10] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:09:11] [V] [TRT] Tactic: 4543151729465212056 Time: 45.154
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:09:11] [V] [TRT] Tactic: 5778138195697110002 Time: 13.8022
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:09:11] [V] [TRT] Tactic: 7098622778606028509 Time: 10.4978
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:09:11] [V] [TRT] Tactic: -9217704540809507511 Time: 11.4636
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:09:11] [V] [TRT] Tactic: -7734972403155710907 Time: 10.1974
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:09:11] [V] [TRT] Tactic: -3855385237722507463 Time: 14.058
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:09:11] [V] [TRT] Tactic: -3360299822783115645 Time: 18.2177
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:09:11] [V] [TRT] Tactic: -2809379259463049392 Time: 13.9262
[11/24/2022-12:09:11] [V] [TRT] node_of_530 + node_of_531 + PWN(node_of_532) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:09:11] [V] [TRT] Tactic: -824800713406371346 Time: 10.5138
[11/24/2022-12:09:11] [V] [TRT] Fastest Tactic: -7734972403155710907 Time: 10.1974
[11/24/2022-12:09:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7734972403155710907
[11/24/2022-12:09:11] [V] [TRT] *************** Autotuning format combination: Float(532224,1:4,6048,36) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:09:11] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:11] [V] [TRT] *************** Autotuning format combination: Half(2128896,14784,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:09:11] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudnnConvolution)
[11/24/2022-12:09:11] [V] [TRT] Tactic: 0 Time: 0.22757
[11/24/2022-12:09:11] [V] [TRT] Tactic: 1 Time: 0.235511
[11/24/2022-12:09:11] [V] [TRT] Tactic: 2 Time: 0.459383
[11/24/2022-12:09:12] [V] [TRT] Tactic: 4 Time: 56.6462
[11/24/2022-12:09:12] [V] [TRT] Tactic: 5 Time: 58.2317
[11/24/2022-12:09:12] [V] [TRT] Tactic: 6 Time: 16.6353
[11/24/2022-12:09:12] [V] [TRT] Tactic: 56 Time: 0.274757
[11/24/2022-12:09:12] [V] [TRT] Tactic: 58 Time: 0.523758
[11/24/2022-12:09:13] [V] [TRT] Tactic: 60 Time: 57.4049
[11/24/2022-12:09:13] [V] [TRT] Tactic: 61 Time: 58.2622
[11/24/2022-12:09:14] [V] [TRT] Tactic: 62 Time: 16.6297
[11/24/2022-12:09:14] [V] [TRT] Fastest Tactic: 0 Time: 0.22757
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Half(1064448,14784:2,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Half(266112,1:8,3024,18) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Half(266112,1:8,3024,18) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudaDepthwiseConvolution)
[11/24/2022-12:09:14] [V] [TRT] Tactic: -2 Time: 0.0905669
[11/24/2022-12:09:14] [V] [TRT] Fastest Tactic: -2 Time: 0.0905669
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Half(133056,1:16,1512,9) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Half(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudaDepthwiseConvolution)
[11/24/2022-12:09:14] [V] [TRT] Tactic: -5 Time: 0.957426
[11/24/2022-12:09:14] [V] [TRT] Fastest Tactic: -5 Time: 0.957426
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudaDepthwiseConvolution)
[11/24/2022-12:09:14] [V] [TRT] Tactic: -3 Time: 0.0457234
[11/24/2022-12:09:14] [V] [TRT] Fastest Tactic: -3 Time: 0.0457234
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Float(73920,14784:32,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudaGroupConvolution)
[11/24/2022-12:09:14] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CudaDepthwiseConvolution)
[11/24/2022-12:09:14] [V] [TRT] Tactic: -4 Time: 0.0496061
[11/24/2022-12:09:14] [V] [TRT] Tactic: 0 Time: 0.04468
[11/24/2022-12:09:14] [V] [TRT] Tactic: 1 Time: 0.0632244
[11/24/2022-12:09:14] [V] [TRT] Tactic: 2 Time: 0.0472331
[11/24/2022-12:09:14] [V] [TRT] Tactic: 3 Time: 0.0545524
[11/24/2022-12:09:14] [V] [TRT] Tactic: 4 Time: 0.0553326
[11/24/2022-12:09:14] [V] [TRT] Tactic: 5 Time: 0.0519817
[11/24/2022-12:09:14] [V] [TRT] Tactic: 6 Time: 0.0595002
[11/24/2022-12:09:14] [V] [TRT] Tactic: 7 Time: 0.0607543
[11/24/2022-12:09:14] [V] [TRT] Tactic: 8 Time: 0.0831954
[11/24/2022-12:09:14] [V] [TRT] Tactic: 9 Time: 0.068576
[11/24/2022-12:09:14] [V] [TRT] Tactic: 10 Time: 0.0530956
[11/24/2022-12:09:14] [V] [TRT] Tactic: 11 Time: 0.0474457
[11/24/2022-12:09:14] [V] [TRT] Tactic: 12 Time: 0.0465051
[11/24/2022-12:09:14] [V] [TRT] Tactic: 13 Time: 0.0435989
[11/24/2022-12:09:14] [V] [TRT] Tactic: 14 Time: 0.050691
[11/24/2022-12:09:14] [V] [TRT] Tactic: 15 Time: 0.048413
[11/24/2022-12:09:14] [V] [TRT] Tactic: 16 Time: 0.0572983
[11/24/2022-12:09:14] [V] [TRT] Tactic: 17 Time: 0.0500495
[11/24/2022-12:09:14] [V] [TRT] Tactic: 18 Time: 0.0780137
[11/24/2022-12:09:14] [V] [TRT] Tactic: 19 Time: 0.0744526
[11/24/2022-12:09:14] [V] [TRT] Tactic: 20 Time: 0.0498956
[11/24/2022-12:09:14] [V] [TRT] Tactic: 21 Time: 0.0506453
[11/24/2022-12:09:14] [V] [TRT] Tactic: 22 Time: 0.048925
[11/24/2022-12:09:14] [V] [TRT] Tactic: 23 Time: 0.0446331
[11/24/2022-12:09:14] [V] [TRT] Tactic: 24 Time: 0.0539703
[11/24/2022-12:09:14] [V] [TRT] Tactic: 25 Time: 0.0509227
[11/24/2022-12:09:14] [V] [TRT] Tactic: 26 Time: 0.0523078
[11/24/2022-12:09:14] [V] [TRT] Tactic: 27 Time: 0.0523185
[11/24/2022-12:09:14] [V] [TRT] Tactic: 28 Time: 0.0764
[11/24/2022-12:09:14] [V] [TRT] Tactic: 29 Time: 0.069728
[11/24/2022-12:09:14] [V] [TRT] Tactic: 30 Time: 0.0537509
[11/24/2022-12:09:14] [V] [TRT] Tactic: 31 Time: 0.0612785
[11/24/2022-12:09:14] [V] [TRT] Tactic: 32 Time: 0.0483764
[11/24/2022-12:09:14] [V] [TRT] Tactic: 33 Time: 0.0529798
[11/24/2022-12:09:14] [V] [TRT] Tactic: 34 Time: 0.0538362
[11/24/2022-12:09:14] [V] [TRT] Tactic: 35 Time: 0.0503086
[11/24/2022-12:09:14] [V] [TRT] Tactic: 36 Time: 0.0550994
[11/24/2022-12:09:14] [V] [TRT] Tactic: 37 Time: 0.0560411
[11/24/2022-12:09:14] [V] [TRT] Tactic: 38 Time: 0.0727246
[11/24/2022-12:09:14] [V] [TRT] Tactic: 39 Time: 0.0616533
[11/24/2022-12:09:14] [V] [TRT] Tactic: 40 Time: 0.0506072
[11/24/2022-12:09:14] [V] [TRT] Tactic: 41 Time: 0.0480701
[11/24/2022-12:09:14] [V] [TRT] Tactic: 42 Time: 0.0470594
[11/24/2022-12:09:14] [V] [TRT] Tactic: 43 Time: 0.0400183
[11/24/2022-12:09:14] [V] [TRT] Tactic: 44 Time: 0.046256
[11/24/2022-12:09:14] [V] [TRT] Tactic: 45 Time: 0.0465691
[11/24/2022-12:09:14] [V] [TRT] Tactic: 46 Time: 0.0539246
[11/24/2022-12:09:14] [V] [TRT] Tactic: 47 Time: 0.0482667
[11/24/2022-12:09:14] [V] [TRT] Tactic: 48 Time: 0.0702217
[11/24/2022-12:09:14] [V] [TRT] Tactic: 49 Time: 0.0700602
[11/24/2022-12:09:14] [V] [TRT] Tactic: 50 Time: 0.0498149
[11/24/2022-12:09:14] [V] [TRT] Tactic: 51 Time: 0.0463097
[11/24/2022-12:09:14] [V] [TRT] Tactic: 52 Time: 0.0499764
[11/24/2022-12:09:14] [V] [TRT] Tactic: 53 Time: 0.0447497
[11/24/2022-12:09:14] [V] [TRT] Tactic: 54 Time: 0.047024
[11/24/2022-12:09:14] [V] [TRT] Tactic: 55 Time: 0.0499246
[11/24/2022-12:09:14] [V] [TRT] Tactic: 56 Time: 0.0520686
[11/24/2022-12:09:14] [V] [TRT] Tactic: 57 Time: 0.0481478
[11/24/2022-12:09:14] [V] [TRT] Tactic: 58 Time: 0.0714804
[11/24/2022-12:09:14] [V] [TRT] Tactic: 59 Time: 0.0624107
[11/24/2022-12:09:14] [V] [TRT] Fastest Tactic: 43 Time: 0.0400183
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_530 + node_of_531 + PWN(node_of_532) (CaskConvolution)
[11/24/2022-12:09:14] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 43
[11/24/2022-12:09:14] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:14] [V] [TRT] *************** Autotuning format combination: Float(2128896,14784,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudaDepthwiseConvolution)
[11/24/2022-12:09:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (FusedConvActConvolution)
[11/24/2022-12:09:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:14] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudnnConvolution)
[11/24/2022-12:09:14] [V] [TRT] Tactic: 0 Time: 0.156407
[11/24/2022-12:09:14] [V] [TRT] Tactic: 1 Time: 0.139518
[11/24/2022-12:09:14] [V] [TRT] Tactic: 2 Time: 0.336905
[11/24/2022-12:09:15] [V] [TRT] Tactic: 4 Time: 40.4354
[11/24/2022-12:09:15] [V] [TRT] Tactic: 5 Time: 0.482057
[11/24/2022-12:09:15] [V] [TRT] Tactic: 56 Time: 0.130503
[11/24/2022-12:09:15] [V] [TRT] Tactic: 57 Time: 0.101259
[11/24/2022-12:09:15] [V] [TRT] Tactic: 58 Time: 0.263008
[11/24/2022-12:09:15] [V] [TRT] Tactic: 60 Time: 37.137
[11/24/2022-12:09:15] [V] [TRT] Tactic: 61 Time: 0.478208
[11/24/2022-12:09:15] [V] [TRT] Tactic: 112 Time: 0.129157
[11/24/2022-12:09:15] [V] [TRT] Tactic: 113 Time: 0.115447
[11/24/2022-12:09:15] [V] [TRT] Tactic: 114 Time: 0.262354
[11/24/2022-12:09:16] [V] [TRT] Tactic: 116 Time: 37.3069
[11/24/2022-12:09:16] [V] [TRT] Tactic: 117 Time: 0.479278
[11/24/2022-12:09:16] [V] [TRT] Fastest Tactic: 57 Time: 0.101259
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:16] [V] [TRT] Tactic: 621442388677115936 Time: 0.22277
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:16] [V] [TRT] Tactic: 697756878388249475 Time: 0.124245
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:16] [V] [TRT] Tactic: 1159272950022995759 Time: 0.13056
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:16] [V] [TRT] Tactic: 1327459216264546184 Time: 0.137678
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:16] [V] [TRT] Tactic: 2290218393647758202 Time: 0.14251
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:16] [V] [TRT] Tactic: 2310520233542099555 Time: 0.301477
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:16] [V] [TRT] Tactic: 3377996665278764661 Time: 0.553952
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:16] [V] [TRT] Tactic: 4032904638566464623 Time: 0.1432
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:16] [V] [TRT] Tactic: 4549827808004681195 Time: 0.12933
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:16] [V] [TRT] Tactic: 4918658762935651592 Time: 0.214638
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:16] [V] [TRT] Tactic: 5779835512569528575 Time: 0.219822
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:16] [V] [TRT] Tactic: 5837905844602864231 Time: 0.253664
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6166883504066133838 Time: 0.27467
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6210049212073459059 Time: 0.123275
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6500866402607985231 Time: 0.163278
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6723161876874263939 Time: 0.110597
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6868013466259746979 Time: 0.209838
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6901214267543238617 Time: 0.158597
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:16] [V] [TRT] Tactic: 8048119769507926928 Time: 0.292187
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:16] [V] [TRT] Tactic: 9151672657204310840 Time: 0.190939
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:16] [V] [TRT] Tactic: -8877086111929938764 Time: 0.219195
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:16] [V] [TRT] Tactic: -8766093103475083267 Time: 0.146135
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:16] [V] [TRT] Tactic: -8198656951359619379 Time: 0.149426
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:16] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0788434
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:16] [V] [TRT] Tactic: -7145578994937510651 Time: 0.261106
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:16] [V] [TRT] Tactic: -7070045993088702524 Time: 0.528942
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:16] [V] [TRT] Tactic: -6622064180404051845 Time: 0.187401
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:16] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0862492
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:16] [V] [TRT] Tactic: -6273689210331812572 Time: 0.218034
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:16] [V] [TRT] Tactic: -4562045946847239058 Time: 0.27605
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:16] [V] [TRT] Tactic: -4337126844824617177 Time: 0.120366
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:16] [V] [TRT] Tactic: -2777237991111865351 Time: 0.309202
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1918478037390720253 Time: 0.158213
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1349585930542925704 Time: 0.1784
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1123676555321336786 Time: 0.222309
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:16] [V] [TRT] Tactic: -701551393537224327 Time: 0.133346
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:16] [V] [TRT] Tactic: -3258434593395023 Time: 0.325134
[11/24/2022-12:09:16] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0788434
[11/24/2022-12:09:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:09:16] [V] [TRT] *************** Autotuning format combination: Float(2128896,1,24192,144), Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:16] [V] [TRT] Tactic: 1162498931361159915 Time: 0.210194
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:16] [V] [TRT] Tactic: 1663866669559596164 Time: 0.210725
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:16] [V] [TRT] Tactic: 2860655430572478466 Time: 0.134898
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:16] [V] [TRT] Tactic: 3887292144336338310 Time: 0.123547
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:16] [V] [TRT] Tactic: 4474630279712975759 Time: 0.10893
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:16] [V] [TRT] Tactic: 4479823862704990365 Time: 0.109045
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:16] [V] [TRT] Tactic: 4696204239951173149 Time: 0.136009
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:16] [V] [TRT] Tactic: 5778138195697110003 Time: 0.213646
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6185707384100198445 Time: 0.118821
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:16] [V] [TRT] Tactic: 8918020581761223752 Time: 0.20736
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:16] [V] [TRT] Tactic: -8031737312007363273 Time: 0.117755
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:16] [V] [TRT] Tactic: -5905193483742532701 Time: 0.129019
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:16] [V] [TRT] Tactic: -4896615592193611463 Time: 0.171886
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:16] [V] [TRT] Tactic: -4056705536979434560 Time: 0.207104
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:16] [V] [TRT] Tactic: -4035591156787122265 Time: 0.108263
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:16] [V] [TRT] Tactic: -3071763921328736248 Time: 0.12067
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:16] [V] [TRT] Tactic: -2809379259463049391 Time: 0.21856
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1985235291706575900 Time: 0.208334
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:16] [V] [TRT] Tactic: -504296718212024303 Time: 0.211305
[11/24/2022-12:09:16] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.108263
[11/24/2022-12:09:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:09:16] [V] [TRT] *************** Autotuning format combination: Float(532224,1:4,6048,36), Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:16] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0922034
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:16] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0909326
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:16] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0985029
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:16] [V] [TRT] Tactic: 5108195418077987197 Time: 0.114037
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:16] [V] [TRT] Tactic: 5380043773350002416 Time: 0.103954
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:16] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0882766
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6031243482516294286 Time: 0.119607
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6419443404913215692 Time: 0.104126
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6571171993204510025 Time: 0.151173
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:16] [V] [TRT] Tactic: 6832381412128253616 Time: 0.131474
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:16] [V] [TRT] Tactic: 7058864664858220889 Time: 0.109522
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:16] [V] [TRT] Tactic: -8853476220903838035 Time: 0.101881
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:16] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0914789
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:16] [V] [TRT] Tactic: -6407735577805887428 Time: 0.116626
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:16] [V] [TRT] Tactic: -6073218138311523634 Time: 0.103947
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:16] [V] [TRT] Tactic: -5033173285090644307 Time: 0.127502
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:16] [V] [TRT] Tactic: -5010594849215755610 Time: 0.114926
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1450865838092804082 Time: 0.15243
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1366318165940453381 Time: 0.106434
[11/24/2022-12:09:16] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:16] [V] [TRT] Tactic: -1138876066247138089 Time: 0.101554
[11/24/2022-12:09:16] [V] [TRT] Fastest Tactic: 5610788582700027969 Time: 0.0882766
[11/24/2022-12:09:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5610788582700027969
[11/24/2022-12:09:16] [V] [TRT] *************** Autotuning format combination: Half(2128896,14784,168,1), Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:09:16] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudnnConvolution)
[11/24/2022-12:09:16] [V] [TRT] Tactic: 0 Time: 0.132117
[11/24/2022-12:09:16] [V] [TRT] Tactic: 1 Time: 0.118377
[11/24/2022-12:09:16] [V] [TRT] Tactic: 2 Time: 0.386405
[11/24/2022-12:09:17] [V] [TRT] Tactic: 4 Time: 37.6768
[11/24/2022-12:09:17] [V] [TRT] Tactic: 5 Time: 0.488453
[11/24/2022-12:09:17] [V] [TRT] Tactic: 56 Time: 0.131278
[11/24/2022-12:09:17] [V] [TRT] Tactic: 58 Time: 0.390345
[11/24/2022-12:09:18] [V] [TRT] Tactic: 60 Time: 37.4356
[11/24/2022-12:09:18] [V] [TRT] Tactic: 61 Time: 0.485755
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: 1 Time: 0.118377
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Half(1064448,14784:2,168,1), Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (FusedConvActConvolution)
[11/24/2022-12:09:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Half(266112,1:8,3024,18), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Half(266112,1:8,3024,18), Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudaDepthwiseConvolution)
[11/24/2022-12:09:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:18] [V] [TRT] Tactic: 254850674756030979 Time: 0.0772846
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0825394
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0547383
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0753349
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0481448
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1576319725282257846 Time: 0.138277
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1832046141070096030 Time: 0.081952
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1838082074606840426 Time: 0.057824
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1877373136269439559 Time: 0.136098
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0826286
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0931931
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2541579301352125276 Time: 0.065984
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2559328254295148085 Time: 0.089168
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2657157263811141609 Time: 0.120229
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0596495
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0506133
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0431771
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0946309
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3513075359009385578 Time: 0.08
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0737349
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0530651
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4278315135102886928 Time: 0.103623
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0423794
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0456743
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0593554
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4528997467275241200 Time: 0.045456
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0609387
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0774126
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0987909
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0691291
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0438423
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0760594
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0819291
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0644465
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0785371
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0720983
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0825851
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0682088
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0875794
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6468794451065529747 Time: 0.079968
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6697277555581639516 Time: 0.056413
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6724319788728799540 Time: 0.13771
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0791977
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0526034
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0673554
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0544396
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0901577
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0767977
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0700449
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0534766
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0483429
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:18] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0382354
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:18] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0692922
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8604374562669615024 Time: 0.102603
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0747634
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0609295
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0533653
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7410012245391920273 Time: 0.119074
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0579078
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0959451
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0543436
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6356316196810535311 Time: 0.128334
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6063766379489217211 Time: 0.082016
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0650575
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0407086
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0629349
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5161596964442251102 Time: 0.085904
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0824549
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5109582882231362997 Time: 0.07632
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0524876
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4796511246675321840 Time: 0.131465
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0877943
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4379519430184503304 Time: 0.065123
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0757714
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0784229
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4021926646879732549 Time: 0.112149
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3987638434926559037 Time: 0.134642
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0729097
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0516328
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3864869056275745423 Time: 0.054688
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0790903
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0602225
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0654476
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0949417
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0457726
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0821006
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0606461
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0827474
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2003055242756584050 Time: 0.076768
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0564571
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0501699
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0669379
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0566431
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1242202084391243207 Time: 0.103285
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0991154
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0757189
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:18] [V] [TRT] Tactic: -406984317033388136 Time: 0.069795
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:18] [V] [TRT] Tactic: -331499326992534460 Time: 0.0657935
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:18] [V] [TRT] Tactic: -206523504474952360 Time: 0.0765029
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.0382354
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Half(133056,1:16,1512,9), Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Half(73920,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CublasConvolution)
[11/24/2022-12:09:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudaDepthwiseConvolution)
[11/24/2022-12:09:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1508480131241957639 Time: 0.100871
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2141154648944475104 Time: 0.100359
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3239257003214966313 Time: 0.102178
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0482469
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0602255
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6580271968881459581 Time: 0.037656
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0603459
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0493029
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0378629
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1425085658556684465 Time: 0.049309
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:18] [V] [TRT] Tactic: -108011214168778087 Time: 0.0373154
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:18] [V] [TRT] Tactic: -42427192380281294 Time: 0.0557806
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0373154
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1), Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudaDepthwiseConvolution)
[11/24/2022-12:09:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (FusedConvActConvolution)
[11/24/2022-12:09:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:18] [V] [TRT] Tactic: 175853789719975416 Time: 0.0291621
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0336137
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0495345
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5834048089706882838 Time: 0.049443
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0838811
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0311653
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0285288
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0473874
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7303593854972602201 Time: 0.032619
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0853851
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0279307
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:18] [V] [TRT] Tactic: -683636008127039856 Time: 0.084896
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.0279307
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:18] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0320521
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2855900226702061782 Time: 0.083104
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0489417
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0831634
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0462686
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6934773036503365000 Time: 0.026733
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0307529
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0844389
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0310811
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0328704
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0286647
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:18] [V] [TRT] Tactic: -868495160148524802 Time: 0.0487314
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.026733
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0395269
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0361817
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0407634
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: 5104832031493112835 Time: 0.0361817
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5104832031493112835
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1), Float(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0422583
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0435234
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:18] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0383109
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4178917718361232468 Time: 0.048355
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0741577
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0689996
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0402537
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:18] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0683657
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7348718297764976805 Time: 0.040152
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0405097
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0446149
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0428949
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0456869
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0382663
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:18] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0443554
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0682149
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7957004747664952265 Time: 0.065501
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0743269
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7633993163187901093 Time: 0.041408
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0461269
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0731223
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:18] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0407669
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:18] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0412811
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5603587790314027122 Time: 0.048093
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:18] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0694552
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:18] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0398423
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0505874
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0492038
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:18] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0430297
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:18] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0457451
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:18] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0471897
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:18] [V] [TRT] Tactic: -621838502160440068 Time: 0.0504533
[11/24/2022-12:09:18] [V] [TRT] Fastest Tactic: -8893439100868426414 Time: 0.0382663
[11/24/2022-12:09:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8893439100868426414
[11/24/2022-12:09:18] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:09:18] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:18] [V] [TRT] Tactic: 424230345342282109 Time: 0.0380651
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0231249
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2327398338581585326 Time: 0.059427
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:18] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0289783
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:18] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0619764
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:18] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0343963
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0430434
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0522606
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0254735
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0593905
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0417931
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:18] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0395931
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0344713
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0242888
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:18] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0260457
[11/24/2022-12:09:18] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:19] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0319177
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:19] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0352183
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:19] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0232555
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:19] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0256518
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:19] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0383166
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:19] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0320247
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:19] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0382926
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:19] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0620282
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:19] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0393486
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:19] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0255657
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:19] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0302117
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:19] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0581851
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:19] [V] [TRT] Tactic: -3514726588976755320 Time: 0.066112
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:19] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0247672
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0619383
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0384309
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:19] [V] [TRT] Tactic: -50323486981480818 Time: 0.0320777
[11/24/2022-12:09:19] [V] [TRT] Fastest Tactic: 2088124366723311762 Time: 0.0231249
[11/24/2022-12:09:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2088124366723311762
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudaGroupConvolution)
[11/24/2022-12:09:19] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:19] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CudaDepthwiseConvolution)
[11/24/2022-12:09:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:19] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (FusedConvActConvolution)
[11/24/2022-12:09:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:19] [V] [TRT] --------------- Timing Runner: node_of_533 + node_of_534 + node_of_535 (CaskConvolution)
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:19] [V] [TRT] Tactic: 125145153013230687 Time: 0.0514987
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:19] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0477501
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:19] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0328649
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:19] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0207856
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:19] [V] [TRT] Tactic: 2756291002030759362 Time: 0.024157
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:19] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0348517
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:19] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0278598
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:19] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0315995
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:19] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0202994
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:19] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0369509
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:19] [V] [TRT] Tactic: 4796956614760326119 Time: 0.026499
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:19] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0220604
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:19] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0306112
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:19] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0209587
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:19] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0339694
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0349239
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6405251167055673379 Time: 0.028445
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0208405
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0312905
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0600564
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0387931
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0352594
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0328494
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:19] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0414869
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:19] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0205688
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:19] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0332434
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:19] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0601737
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:19] [V] [TRT] Tactic: 8234775147403903473 Time: 0.03732
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:19] [V] [TRT] Tactic: 8524082966802584889 Time: 0.030645
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:19] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0328887
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:19] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0328466
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:19] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0356069
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:19] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0200994
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:19] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0197691
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:19] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0337198
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:19] [V] [TRT] Tactic: -5671123121710113970 Time: 0.032917
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:19] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0357458
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:19] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0317833
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:19] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0244731
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:19] [V] [TRT] Tactic: -4425346730823666456 Time: 0.03972
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:19] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0357314
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:19] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0631147
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:19] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0180834
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:19] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0225247
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:19] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0495863
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:19] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0201257
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:19] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0481097
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:19] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0647025
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1916483171117495388 Time: 0.039256
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0407703
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1328736756812546664 Time: 0.035816
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1006589727652607355 Time: 0.018184
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:19] [V] [TRT] Tactic: -405554772060757402 Time: 0.0222171
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:19] [V] [TRT] Tactic: -375949437730908730 Time: 0.0257661
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:19] [V] [TRT] Tactic: -111878368089469751 Time: 0.0402789
[11/24/2022-12:09:19] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:19] [V] [TRT] Tactic: -19707840769375107 Time: 0.0185623
[11/24/2022-12:09:19] [V] [TRT] Fastest Tactic: -3825889760337461729 Time: 0.0180834
[11/24/2022-12:09:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3825889760337461729
[11/24/2022-12:09:19] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(2128896,1,24192,144) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(532224,1:4,6048,36) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(2128896,14784,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(1064448,14784:2,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(266112,1:8,3024,18) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(133056,1:16,1512,9) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(532224,14784:4,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(2128896,14784,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(73920,14784:32,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(73920,14784:32,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(73920,14784:32,168,1) ***************
[11/24/2022-12:09:19] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:19] [V] [TRT] *************** Autotuning format combination: Float(2128896,14784,168,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:09:19] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudaDepthwiseConvolution)
[11/24/2022-12:09:19] [V] [TRT] Tactic: -1 Time: 0.141419
[11/24/2022-12:09:19] [V] [TRT] Fastest Tactic: -1 Time: 0.141419
[11/24/2022-12:09:19] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudnnConvolution)
[11/24/2022-12:09:19] [V] [TRT] Tactic: 0 Time: 0.142665
[11/24/2022-12:09:19] [V] [TRT] Tactic: 1 Time: 0.144146
[11/24/2022-12:09:19] [V] [TRT] Tactic: 2 Time: 0.144965
[11/24/2022-12:09:19] [V] [TRT] Tactic: 5 Time: 33.4986
[11/24/2022-12:09:19] [V] [TRT] Tactic: 56 Time: 0.144951
[11/24/2022-12:09:19] [V] [TRT] Tactic: 57 Time: 0.143154
[11/24/2022-12:09:19] [V] [TRT] Tactic: 58 Time: 0.143758
[11/24/2022-12:09:19] [V] [TRT] Tactic: 61 Time: 33.462
[11/24/2022-12:09:19] [V] [TRT] Tactic: 112 Time: 0.144155
[11/24/2022-12:09:19] [V] [TRT] Tactic: 113 Time: 0.144192
[11/24/2022-12:09:19] [V] [TRT] Tactic: 114 Time: 0.145861
[11/24/2022-12:09:20] [V] [TRT] Tactic: 117 Time: 33.3993
[11/24/2022-12:09:20] [V] [TRT] Fastest Tactic: 0 Time: 0.142665
[11/24/2022-12:09:20] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:09:20] [V] [TRT] Tactic: 130477820174479366 Time: 3.77262
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:09:20] [V] [TRT] Tactic: 1358952225285826925 Time: 2.27781
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:20] [V] [TRT] Tactic: 4549827808004681195 Time: 1.97948
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:09:20] [V] [TRT] Tactic: 5127140674766136213 Time: 2.25786
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:09:20] [V] [TRT] Tactic: 5691674214365884252 Time: 3.48704
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:20] [V] [TRT] Tactic: 5779835512569528575 Time: 2.60588
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:09:20] [V] [TRT] Tactic: 6053873026024413720 Time: 3.4356
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:09:20] [V] [TRT] Tactic: 6532229230713743445 Time: 3.9043
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:09:20] [V] [TRT] Tactic: 6767548733843469815 Time: 1.9752
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:09:20] [V] [TRT] Tactic: -6693149634808211969 Time: 2.4142
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:20] [V] [TRT] Tactic: -6313876406580483184 Time: 1.7835
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:09:20] [V] [TRT] Tactic: -4932505327461806800 Time: 3.67768
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:09:20] [V] [TRT] Tactic: -2870780723387717246 Time: 2.58145
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:20] [V] [TRT] Tactic: -1123676555321336786 Time: 2.61092
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:20] [V] [TRT] Tactic: -701551393537224327 Time: 1.98189
[11/24/2022-12:09:20] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 1.7835
[11/24/2022-12:09:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:09:20] [V] [TRT] *************** Autotuning format combination: Float(2128896,1,24192,144) -> Float(532224,1,12096,144) ***************
[11/24/2022-12:09:20] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:09:20] [V] [TRT] Tactic: 1852818056038333088 Time: 3.50049
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:09:20] [V] [TRT] Tactic: 2137271960938803767 Time: 3.34352
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:09:20] [V] [TRT] Tactic: 4543151729465212056 Time: 13.4212
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:09:20] [V] [TRT] Tactic: 5778138195697110002 Time: 3.46669
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:09:20] [V] [TRT] Tactic: 7098622778606028509 Time: 3.37509
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:09:20] [V] [TRT] Tactic: -9217704540809507511 Time: 4.03639
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:09:20] [V] [TRT] Tactic: -7734972403155710907 Time: 3.30934
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:09:20] [V] [TRT] Tactic: -3855385237722507463 Time: 3.53441
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:09:20] [V] [TRT] Tactic: -3360299822783115645 Time: 5.62538
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:09:20] [V] [TRT] Tactic: -2809379259463049392 Time: 3.49568
[11/24/2022-12:09:20] [V] [TRT] node_of_539 + node_of_540 + PWN(node_of_541) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:09:20] [V] [TRT] Tactic: -824800713406371346 Time: 3.19546
[11/24/2022-12:09:20] [V] [TRT] Fastest Tactic: -824800713406371346 Time: 3.19546
[11/24/2022-12:09:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -824800713406371346
[11/24/2022-12:09:20] [V] [TRT] *************** Autotuning format combination: Float(532224,1:4,6048,36) -> Float(133056,1:4,3024,36) ***************
[11/24/2022-12:09:20] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:20] [V] [TRT] *************** Autotuning format combination: Half(2128896,14784,168,1) -> Half(532224,3696,84,1) ***************
[11/24/2022-12:09:20] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudnnConvolution)
[11/24/2022-12:09:20] [V] [TRT] Tactic: 0 Time: 0.083232
[11/24/2022-12:09:20] [V] [TRT] Tactic: 1 Time: 0.0817554
[11/24/2022-12:09:21] [V] [TRT] Tactic: 2 Time: 0.12331
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5 Time: 38.3405
[11/24/2022-12:09:21] [V] [TRT] Tactic: 56 Time: 0.0910469
[11/24/2022-12:09:21] [V] [TRT] Tactic: 58 Time: 0.142315
[11/24/2022-12:09:21] [V] [TRT] Tactic: 61 Time: 57.2472
[11/24/2022-12:09:21] [V] [TRT] Fastest Tactic: 1 Time: 0.0817554
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Half(1064448,14784:2,168,1) -> Half(266112,3696:2,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Half(266112,1:8,3024,18) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Half(266112,1:8,3024,18) -> Half(66528,1:8,1512,18) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudaDepthwiseConvolution)
[11/24/2022-12:09:21] [V] [TRT] Tactic: -2 Time: 0.0574522
[11/24/2022-12:09:21] [V] [TRT] Fastest Tactic: -2 Time: 0.0574522
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Half(133056,1:16,1512,9) -> Half(33264,1:16,756,9) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Half(73920,14784:32,168,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudaDepthwiseConvolution)
[11/24/2022-12:09:21] [V] [TRT] Tactic: -5 Time: 0.255785
[11/24/2022-12:09:21] [V] [TRT] Fastest Tactic: -5 Time: 0.255785
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1) -> Int8(133056,3696:4,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudaDepthwiseConvolution)
[11/24/2022-12:09:21] [V] [TRT] Tactic: -3 Time: 0.0226534
[11/24/2022-12:09:21] [V] [TRT] Fastest Tactic: -3 Time: 0.0226534
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(532224,14784:4,168,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Float(532224,3696,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Float(18480,3696:32,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Half(18480,3696:32,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Int8(73920,14784:32,168,1) -> Int8(18480,3696:32,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudaGroupConvolution)
[11/24/2022-12:09:21] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CudaDepthwiseConvolution)
[11/24/2022-12:09:21] [V] [TRT] Tactic: -4 Time: 0.0177859
[11/24/2022-12:09:21] [V] [TRT] Tactic: 0 Time: 0.020913
[11/24/2022-12:09:21] [V] [TRT] Tactic: 1 Time: 0.0235781
[11/24/2022-12:09:21] [V] [TRT] Tactic: 2 Time: 0.023965
[11/24/2022-12:09:21] [V] [TRT] Tactic: 3 Time: 0.0252648
[11/24/2022-12:09:21] [V] [TRT] Tactic: 4 Time: 0.0264213
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5 Time: 0.0354249
[11/24/2022-12:09:21] [V] [TRT] Tactic: 6 Time: 0.034475
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7 Time: 0.041192
[11/24/2022-12:09:21] [V] [TRT] Tactic: 8 Time: 0.047088
[11/24/2022-12:09:21] [V] [TRT] Tactic: 9 Time: 0.0438103
[11/24/2022-12:09:21] [V] [TRT] Tactic: 10 Time: 0.0209881
[11/24/2022-12:09:21] [V] [TRT] Tactic: 11 Time: 0.0210122
[11/24/2022-12:09:21] [V] [TRT] Tactic: 12 Time: 0.0236003
[11/24/2022-12:09:21] [V] [TRT] Tactic: 13 Time: 0.0214361
[11/24/2022-12:09:21] [V] [TRT] Tactic: 14 Time: 0.0263901
[11/24/2022-12:09:21] [V] [TRT] Tactic: 15 Time: 0.0240008
[11/24/2022-12:09:21] [V] [TRT] Tactic: 16 Time: 0.0454263
[11/24/2022-12:09:21] [V] [TRT] Tactic: 17 Time: 0.032299
[11/24/2022-12:09:21] [V] [TRT] Tactic: 18 Time: 0.0470983
[11/24/2022-12:09:21] [V] [TRT] Tactic: 19 Time: 0.0437269
[11/24/2022-12:09:21] [V] [TRT] Tactic: 20 Time: 0.0209913
[11/24/2022-12:09:21] [V] [TRT] Tactic: 21 Time: 0.0207882
[11/24/2022-12:09:21] [V] [TRT] Tactic: 22 Time: 0.0236167
[11/24/2022-12:09:21] [V] [TRT] Tactic: 23 Time: 0.0208451
[11/24/2022-12:09:21] [V] [TRT] Tactic: 24 Time: 0.0266011
[11/24/2022-12:09:21] [V] [TRT] Tactic: 25 Time: 0.0242987
[11/24/2022-12:09:21] [V] [TRT] Tactic: 26 Time: 0.0442846
[11/24/2022-12:09:21] [V] [TRT] Tactic: 27 Time: 0.0325888
[11/24/2022-12:09:21] [V] [TRT] Tactic: 28 Time: 0.0583604
[11/24/2022-12:09:21] [V] [TRT] Tactic: 29 Time: 0.0437166
[11/24/2022-12:09:21] [V] [TRT] Fastest Tactic: -4 Time: 0.0177859
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_539 + node_of_540 + PWN(node_of_541) (CaskConvolution)
[11/24/2022-12:09:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -4
[11/24/2022-12:09:21] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:21] [V] [TRT] *************** Autotuning format combination: Float(532224,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudaDepthwiseConvolution)
[11/24/2022-12:09:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (FusedConvActConvolution)
[11/24/2022-12:09:21] [V] [TRT] Tactic: 589823 Time: 0.0709592
[11/24/2022-12:09:21] [V] [TRT] Tactic: 655359 Time: 0.0886811
[11/24/2022-12:09:21] [V] [TRT] Tactic: 786431 Time: 0.049565
[11/24/2022-12:09:21] [V] [TRT] Tactic: 851967 Time: 0.081856
[11/24/2022-12:09:21] [V] [TRT] Tactic: 1179647 Time: 0.056832
[11/24/2022-12:09:21] [V] [TRT] Tactic: 1638399 Time: 0.0488168
[11/24/2022-12:09:21] [V] [TRT] Tactic: 3538943 Time: 0.0538453
[11/24/2022-12:09:21] [V] [TRT] Tactic: 3932159 Time: 0.0793851
[11/24/2022-12:09:21] [V] [TRT] Tactic: 3997695 Time: 0.0474366
[11/24/2022-12:09:21] [V] [TRT] Tactic: 4194303 Time: 0.0487634
[11/24/2022-12:09:21] [V] [TRT] Tactic: 4587519 Time: 0.0450446
[11/24/2022-12:09:21] [V] [TRT] Tactic: 4653055 Time: 0.0555322
[11/24/2022-12:09:21] [V] [TRT] Tactic: 4915199 Time: 0.0494187
[11/24/2022-12:09:21] [V] [TRT] Tactic: 4980735 Time: 0.0489432
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5177343 Time: 0.0587657
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5242879 Time: 0.0769051
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5373951 Time: 0.076832
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5570559 Time: 0.0749737
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5767167 Time: 0.130542
[11/24/2022-12:09:21] [V] [TRT] Tactic: 5898239 Time: 0.0570941
[11/24/2022-12:09:21] [V] [TRT] Tactic: 6225919 Time: 0.0525608
[11/24/2022-12:09:21] [V] [TRT] Tactic: 6291455 Time: 0.0589242
[11/24/2022-12:09:21] [V] [TRT] Tactic: 6815743 Time: 0.0664
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7077887 Time: 0.0528396
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7143423 Time: 0.0761691
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7208959 Time: 0.0621547
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7340031 Time: 0.0605851
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7536639 Time: 0.092048
[11/24/2022-12:09:21] [V] [TRT] Tactic: 7733247 Time: 0.0574354
[11/24/2022-12:09:21] [V] [TRT] Tactic: 8191999 Time: 0.0590674
[11/24/2022-12:09:21] [V] [TRT] Tactic: 8716287 Time: 0.0750949
[11/24/2022-12:09:21] [V] [TRT] Tactic: 9568255 Time: 0.0501592
[11/24/2022-12:09:21] [V] [TRT] Tactic: 10354687 Time: 0.0499291
[11/24/2022-12:09:21] [V] [TRT] Tactic: 10747903 Time: 0.0565166
[11/24/2022-12:09:21] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0450446
[11/24/2022-12:09:21] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudnnConvolution)
[11/24/2022-12:09:21] [V] [TRT] Tactic: 0 Time: 0.0463371
[11/24/2022-12:09:21] [V] [TRT] Tactic: 1 Time: 0.0514331
[11/24/2022-12:09:21] [V] [TRT] Tactic: 2 Time: 0.180471
[11/24/2022-12:09:22] [V] [TRT] Tactic: 4 Time: 40.7012
[11/24/2022-12:09:22] [V] [TRT] Tactic: 5 Time: 0.183483
[11/24/2022-12:09:22] [V] [TRT] Tactic: 56 Time: 0.0420069
[11/24/2022-12:09:22] [V] [TRT] Tactic: 57 Time: 0.0499718
[11/24/2022-12:09:22] [V] [TRT] Tactic: 58 Time: 0.152229
[11/24/2022-12:09:22] [V] [TRT] Tactic: 60 Time: 31.188
[11/24/2022-12:09:22] [V] [TRT] Tactic: 61 Time: 0.182222
[11/24/2022-12:09:22] [V] [TRT] Tactic: 112 Time: 0.0446114
[11/24/2022-12:09:22] [V] [TRT] Tactic: 113 Time: 0.0488213
[11/24/2022-12:09:22] [V] [TRT] Tactic: 114 Time: 0.135783
[11/24/2022-12:09:23] [V] [TRT] Tactic: 116 Time: 31.1256
[11/24/2022-12:09:23] [V] [TRT] Tactic: 117 Time: 0.18459
[11/24/2022-12:09:23] [V] [TRT] Fastest Tactic: 56 Time: 0.0420069
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:23] [V] [TRT] Tactic: 621442388677115936 Time: 0.0559025
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:23] [V] [TRT] Tactic: 697756878388249475 Time: 0.0309294
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:23] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0296521
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:23] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0349111
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:23] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0413234
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:23] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0562575
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:23] [V] [TRT] Tactic: 3377996665278764661 Time: 0.12645
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0330213
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0372491
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0490103
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5779835512569528575 Time: 0.058595
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0365451
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0458629
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0266263
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6500866402607985231 Time: 0.03728
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6723161876874263939 Time: 0.024592
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0478309
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0392217
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:23] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0518842
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:23] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0299566
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:23] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0345838
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:23] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0411771
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:23] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0384869
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:23] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0309705
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:23] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0668998
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:23] [V] [TRT] Tactic: -7070045993088702524 Time: 0.123461
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:23] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0289746
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:23] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0326711
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:23] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0583055
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:23] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0687192
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:23] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0336192
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:23] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0574415
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0388503
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1349585930542925704 Time: 0.043752
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0600792
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:23] [V] [TRT] Tactic: -701551393537224327 Time: 0.0384583
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:23] [V] [TRT] Tactic: -3258434593395023 Time: 0.0634453
[11/24/2022-12:09:23] [V] [TRT] Fastest Tactic: 6723161876874263939 Time: 0.024592
[11/24/2022-12:09:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6723161876874263939
[11/24/2022-12:09:23] [V] [TRT] *************** Autotuning format combination: Float(532224,1,12096,144) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:23] [V] [TRT] Tactic: 1162498931361159915 Time: 0.058208
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:23] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0561783
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:23] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0360526
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:23] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0317577
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4474630279712975759 Time: 0.025805
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0256168
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0370697
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0564114
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6185707384100198445 Time: 0.033536
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:23] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0551832
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:23] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0331877
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:23] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0331109
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:23] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0352539
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:23] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0570758
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:23] [V] [TRT] Tactic: -4035591156787122265 Time: 0.024781
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:23] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0312402
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:23] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0568579
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0547962
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:23] [V] [TRT] Tactic: -504296718212024303 Time: 0.0548983
[11/24/2022-12:09:23] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.024781
[11/24/2022-12:09:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:09:23] [V] [TRT] *************** Autotuning format combination: Float(133056,1:4,3024,36) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:23] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0202006
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:23] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0159131
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:23] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0181549
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0245006
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0187989
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0140484
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0244808
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0202371
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0350757
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:23] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0307328
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:23] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0203966
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:23] [V] [TRT] Tactic: -8853476220903838035 Time: 0.020446
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:23] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0201897
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:23] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0263771
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:23] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0204317
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:23] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0292782
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:23] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0240259
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0370674
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0225065
[11/24/2022-12:09:23] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:23] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0183989
[11/24/2022-12:09:23] [V] [TRT] Fastest Tactic: 5610788582700027969 Time: 0.0140484
[11/24/2022-12:09:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5610788582700027969
[11/24/2022-12:09:23] [V] [TRT] *************** Autotuning format combination: Half(532224,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:09:23] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudnnConvolution)
[11/24/2022-12:09:23] [V] [TRT] Tactic: 0 Time: 0.0403371
[11/24/2022-12:09:23] [V] [TRT] Tactic: 1 Time: 0.0495634
[11/24/2022-12:09:23] [V] [TRT] Tactic: 2 Time: 0.126599
[11/24/2022-12:09:23] [V] [TRT] Tactic: 4 Time: 31.2283
[11/24/2022-12:09:23] [V] [TRT] Tactic: 5 Time: 0.158021
[11/24/2022-12:09:23] [V] [TRT] Tactic: 56 Time: 0.0390926
[11/24/2022-12:09:23] [V] [TRT] Tactic: 58 Time: 0.126105
[11/24/2022-12:09:24] [V] [TRT] Tactic: 60 Time: 31.4106
[11/24/2022-12:09:24] [V] [TRT] Tactic: 61 Time: 0.162523
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: 56 Time: 0.0390926
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Half(266112,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Half(266112,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (FusedConvActConvolution)
[11/24/2022-12:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,1512,18) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,1512,18) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudaDepthwiseConvolution)
[11/24/2022-12:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:24] [V] [TRT] Tactic: 254850674756030979 Time: 0.0157847
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0159517
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1044128949445110119 Time: 0.011909
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0160218
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0139312
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0268198
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0159568
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0138581
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0302766
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0177189
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0198606
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0157778
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0223719
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0243878
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0138294
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0119364
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3359475309458902373 Time: 0.00987124
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0186446
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0161559
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0159756
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0138078
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0244145
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4370476717970497892 Time: 0.00960031
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0116051
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4491683531415781597 Time: 0.013558
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0109832
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0122057
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0160467
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0223517
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0136224
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0115604
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0156837
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0159192
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5205510332404400949 Time: 0.014613
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0181166
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0138647
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0181017
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0159294
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6377497238381488891 Time: 0.018372
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0165501
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0157632
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0309129
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0162189
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0140069
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0129924
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0117609
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0179903
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0160803
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0138801
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0115668
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0137671
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:24] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00949257
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:24] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0137513
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0224281
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0152347
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0136769
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0116663
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0224797
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0158954
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0204611
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0139287
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6356316196810535311 Time: 0.024701
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0158368
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0157463
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0098688
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0120693
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0202457
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0183051
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0160213
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0139985
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0282286
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0165039
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0123851
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0161234
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0159766
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0245638
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0286802
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0139611
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0120354
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0136021
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0161412
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0116223
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0157344
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0202857
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0112478
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0182229
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0135992
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0160508
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0180457
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0138211
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0116856
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0135269
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1562548049711204899 Time: 0.013856
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0229753
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0214648
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0143177
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:24] [V] [TRT] Tactic: -406984317033388136 Time: 0.0158908
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:24] [V] [TRT] Tactic: -331499326992534460 Time: 0.0119733
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:24] [V] [TRT] Tactic: -206523504474952360 Time: 0.0178296
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.00949257
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Half(33264,1:16,756,9) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Half(18480,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CublasConvolution)
[11/24/2022-12:09:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(133056,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudaDepthwiseConvolution)
[11/24/2022-12:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0300571
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0293888
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3239257003214966313 Time: 0.029739
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0159797
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0203177
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0159446
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0204865
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0159721
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0161976
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0161128
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:24] [V] [TRT] Tactic: -108011214168778087 Time: 0.0159558
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:24] [V] [TRT] Tactic: -42427192380281294 Time: 0.0204017
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0159446
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(133056,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudaDepthwiseConvolution)
[11/24/2022-12:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (FusedConvActConvolution)
[11/24/2022-12:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:24] [V] [TRT] Tactic: 175853789719975416 Time: 0.0138971
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0138186
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0179303
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0179954
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0262027
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0136756
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0137056
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0162347
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0136748
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6585664687867083638 Time: 0.026403
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3326139578711341011 Time: 0.013649
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:24] [V] [TRT] Tactic: -683636008127039856 Time: 0.0264815
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.013649
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(133056,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0137351
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2855900226702061782 Time: 0.025776
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0178966
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0264777
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0161681
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0137658
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0135431
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4255737803793506479 Time: 0.026432
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0136303
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0138901
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0139088
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:24] [V] [TRT] Tactic: -868495160148524802 Time: 0.018048
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: -4431642509665791294 Time: 0.0135431
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4431642509665791294
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(18480,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0101602
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0115566
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0108722
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0101602
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(18480,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0115211
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00934543
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00978834
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0119798
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0153568
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0156402
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0113758
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0177874
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0117391
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0114409
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0118161
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00955429
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0131142
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0117785
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0126823
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7988637803896331454 Time: 0.015499
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0162016
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0143095
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7633993163187901093 Time: 0.010989
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0123067
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0149477
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00977646
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0113129
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0126206
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0145678
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0113087
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3665201838779845683 Time: 0.01376
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0125246
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0119185
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2342404147487779225 Time: 0.011597
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0133789
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:24] [V] [TRT] Tactic: -621838502160440068 Time: 0.0136702
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.00934543
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(18480,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:24] [V] [TRT] Tactic: 424230345342282109 Time: 0.0119026
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00902314
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0152101
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2881044142075831475 Time: 0.00986697
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0149998
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0116494
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0115362
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0144942
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00928571
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0151168
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0128392
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0118013
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0114644
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00974659
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00913657
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:24] [V] [TRT] Tactic: 9072692108481390634 Time: 0.01152
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8897233019398469012 Time: 0.01127
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00767615
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0098755
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0118653
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0118639
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0112485
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0162067
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0116487
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00823771
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00925829
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0140954
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0178806
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00979657
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0143067
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0118421
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:24] [V] [TRT] Tactic: -50323486981480818 Time: 0.0116596
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.00767615
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Int8(18480,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudaGroupConvolution)
[11/24/2022-12:09:24] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CudaDepthwiseConvolution)
[11/24/2022-12:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (FusedConvActConvolution)
[11/24/2022-12:09:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_542 + node_of_543 (CaskConvolution)
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:24] [V] [TRT] Tactic: 125145153013230687 Time: 0.0153312
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1583811548148740665 Time: 0.014257
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0119455
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:24] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00904514
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:24] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00931229
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0119931
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0099712
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:24] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0115073
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00978347
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0118664
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:24] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00973227
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00919971
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5443897483205284103 Time: 0.011597
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00910429
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:24] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0115924
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0155694
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00985387
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6433368103202497147 Time: 0.00919886
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0116104
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0201086
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0132663
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0113083
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0115851
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:24] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0156009
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:24] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00981608
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0113414
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8173975624668590862 Time: 0.016863
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0114985
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0116248
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:24] [V] [TRT] Tactic: 8765382722978397630 Time: 0.012661
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:24] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0118681
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:24] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0131503
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00966187
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00842864
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:24] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0141307
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0120076
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0139379
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:24] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0115685
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00975634
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0116677
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0134454
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:24] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0201903
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00784722
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00971886
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:24] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0140758
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00775844
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0139545
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:24] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0181851
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0139204
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0157239
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0121985
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:24] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00865936
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:24] [V] [TRT] Tactic: -405554772060757402 Time: 0.00961676
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:24] [V] [TRT] Tactic: -375949437730908730 Time: 0.00940314
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:24] [V] [TRT] Tactic: -111878368089469751 Time: 0.0116877
[11/24/2022-12:09:24] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:24] [V] [TRT] Tactic: -19707840769375107 Time: 0.00766604
[11/24/2022-12:09:24] [V] [TRT] Fastest Tactic: -19707840769375107 Time: 0.00766604
[11/24/2022-12:09:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -19707840769375107
[11/24/2022-12:09:24] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:24] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudaDepthwiseConvolution)
[11/24/2022-12:09:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:24] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (FusedConvActConvolution)
[11/24/2022-12:09:24] [V] [TRT] Tactic: 589823 Time: 0.192215
[11/24/2022-12:09:25] [V] [TRT] Tactic: 655359 Time: 0.264567
[11/24/2022-12:09:25] [V] [TRT] Tactic: 786431 Time: 0.171721
[11/24/2022-12:09:25] [V] [TRT] Tactic: 851967 Time: 0.250464
[11/24/2022-12:09:25] [V] [TRT] Tactic: 1179647 Time: 0.261705
[11/24/2022-12:09:25] [V] [TRT] Tactic: 1638399 Time: 0.170377
[11/24/2022-12:09:25] [V] [TRT] Tactic: 2097151 Time: 0.166528
[11/24/2022-12:09:25] [V] [TRT] Tactic: 3538943 Time: 0.261266
[11/24/2022-12:09:25] [V] [TRT] Tactic: 3932159 Time: 0.27056
[11/24/2022-12:09:25] [V] [TRT] Tactic: 3997695 Time: 0.170981
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4194303 Time: 0.171625
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4259839 Time: 0.172242
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4587519 Time: 0.169728
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4653055 Time: 0.257317
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4915199 Time: 0.179273
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4980735 Time: 0.168197
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5177343 Time: 0.261079
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5242879 Time: 0.26656
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5373951 Time: 0.260965
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5570559 Time: 0.254217
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5767167 Time: 0.212827
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5898239 Time: 0.26155
[11/24/2022-12:09:25] [V] [TRT] Tactic: 6225919 Time: 0.262565
[11/24/2022-12:09:25] [V] [TRT] Tactic: 6291455 Time: 0.2592
[11/24/2022-12:09:25] [V] [TRT] Tactic: 6815743 Time: 0.267493
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7012351 Time: 0.173152
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7077887 Time: 0.262441
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7143423 Time: 0.194926
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7208959 Time: 0.264992
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7340031 Time: 0.25808
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7536639 Time: 0.289463
[11/24/2022-12:09:25] [V] [TRT] Tactic: 7733247 Time: 0.260169
[11/24/2022-12:09:25] [V] [TRT] Tactic: 8191999 Time: 0.179552
[11/24/2022-12:09:25] [V] [TRT] Tactic: 8716287 Time: 0.267986
[11/24/2022-12:09:25] [V] [TRT] Tactic: 9109503 Time: 0.170519
[11/24/2022-12:09:25] [V] [TRT] Tactic: 9568255 Time: 0.170725
[11/24/2022-12:09:25] [V] [TRT] Tactic: 10354687 Time: 0.182126
[11/24/2022-12:09:25] [V] [TRT] Tactic: 10747903 Time: 0.25995
[11/24/2022-12:09:25] [V] [TRT] Fastest Tactic: 2097151 Time: 0.166528
[11/24/2022-12:09:25] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudnnConvolution)
[11/24/2022-12:09:25] [V] [TRT] Tactic: 0 Time: 0.113495
[11/24/2022-12:09:25] [V] [TRT] Tactic: 1 Time: 0.120702
[11/24/2022-12:09:25] [V] [TRT] Tactic: 2 Time: 0.133131
[11/24/2022-12:09:25] [V] [TRT] Tactic: 4 Time: 60.5131
[11/24/2022-12:09:25] [V] [TRT] Tactic: 5 Time: 0.240238
[11/24/2022-12:09:25] [V] [TRT] Tactic: 56 Time: 0.11141
[11/24/2022-12:09:25] [V] [TRT] Tactic: 57 Time: 0.102379
[11/24/2022-12:09:25] [V] [TRT] Tactic: 58 Time: 0.141223
[11/24/2022-12:09:26] [V] [TRT] Tactic: 60 Time: 60.5151
[11/24/2022-12:09:26] [V] [TRT] Tactic: 61 Time: 0.24032
[11/24/2022-12:09:26] [V] [TRT] Tactic: 112 Time: 0.119237
[11/24/2022-12:09:26] [V] [TRT] Tactic: 113 Time: 0.0907497
[11/24/2022-12:09:26] [V] [TRT] Tactic: 114 Time: 0.130626
[11/24/2022-12:09:27] [V] [TRT] Tactic: 116 Time: 60.5372
[11/24/2022-12:09:27] [V] [TRT] Tactic: 117 Time: 0.235127
[11/24/2022-12:09:27] [V] [TRT] Fastest Tactic: 113 Time: 0.0907497
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:27] [V] [TRT] Tactic: 621442388677115936 Time: 0.0794834
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:27] [V] [TRT] Tactic: 697756878388249475 Time: 0.0877623
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:27] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0533105
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:27] [V] [TRT] Tactic: 1327459216264546184 Time: 0.107106
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:27] [V] [TRT] Tactic: 2290218393647758202 Time: 0.047875
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:27] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0401554
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:27] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0585448
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:27] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0610286
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:27] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0368286
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:27] [V] [TRT] Tactic: 4918658762935651592 Time: 0.103566
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:27] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0454583
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:27] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0574461
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0580952
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0470046
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0689219
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6723161876874263939 Time: 0.040872
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0636724
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0638842
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:27] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0713112
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:27] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0408423
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:27] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0445234
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:27] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0453051
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:27] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0465131
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:27] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0363554
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:27] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0573821
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:27] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0592564
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:27] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0369154
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:27] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0382663
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:27] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0422309
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:27] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0598491
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:27] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0354816
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:27] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0442343
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0511802
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0776617
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0433554
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:27] [V] [TRT] Tactic: -701551393537224327 Time: 0.0371634
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:27] [V] [TRT] Tactic: -3258434593395023 Time: 0.0548343
[11/24/2022-12:09:27] [V] [TRT] Fastest Tactic: -4337126844824617177 Time: 0.0354816
[11/24/2022-12:09:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4337126844824617177
[11/24/2022-12:09:27] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:27] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0477821
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:27] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0380434
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:27] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0386754
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:27] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0392171
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:27] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0511147
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:27] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0521615
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:27] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0377383
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:27] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0396171
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0375097
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:27] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0383154
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:27] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0364811
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:27] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0359806
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:27] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0439943
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:27] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0463623
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:27] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0501699
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:27] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0369817
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:27] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0385726
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0381714
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:27] [V] [TRT] Tactic: -504296718212024303 Time: 0.0371977
[11/24/2022-12:09:27] [V] [TRT] Fastest Tactic: -5905193483742532701 Time: 0.0359806
[11/24/2022-12:09:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5905193483742532701
[11/24/2022-12:09:27] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:27] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:27] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0242232
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:27] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0288805
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:27] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0294821
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:27] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0386857
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:27] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0312512
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:27] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0254781
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0295067
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0253905
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0250827
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:27] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0368926
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:27] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0371714
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:27] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0584792
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:27] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0251528
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:27] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0420149
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:27] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0271947
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:27] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0320594
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:27] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0278842
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0247413
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0637928
[11/24/2022-12:09:27] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:27] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0324041
[11/24/2022-12:09:27] [V] [TRT] Fastest Tactic: 1373022415249282411 Time: 0.0242232
[11/24/2022-12:09:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1373022415249282411
[11/24/2022-12:09:27] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:27] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudnnConvolution)
[11/24/2022-12:09:27] [V] [TRT] Tactic: 0 Time: 0.083616
[11/24/2022-12:09:27] [V] [TRT] Tactic: 1 Time: 0.0858103
[11/24/2022-12:09:27] [V] [TRT] Tactic: 2 Time: 0.103486
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4 Time: 60.554
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5 Time: 0.21189
[11/24/2022-12:09:28] [V] [TRT] Tactic: 56 Time: 0.0839794
[11/24/2022-12:09:28] [V] [TRT] Tactic: 58 Time: 0.104027
[11/24/2022-12:09:28] [V] [TRT] Tactic: 60 Time: 60.5257
[11/24/2022-12:09:28] [V] [TRT] Tactic: 61 Time: 0.212631
[11/24/2022-12:09:28] [V] [TRT] Fastest Tactic: 0 Time: 0.083616
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:09:28] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (FusedConvActConvolution)
[11/24/2022-12:09:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:09:28] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0256983
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0371429
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0239291
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0235566
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:09:28] [V] [TRT] Tactic: 6057304366605292508 Time: 0.023422
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:09:28] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0237283
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:09:28] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0281051
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:09:28] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0251505
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:09:28] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0366994
[11/24/2022-12:09:28] [V] [TRT] Fastest Tactic: 6057304366605292508 Time: 0.023422
[11/24/2022-12:09:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6057304366605292508
[11/24/2022-12:09:28] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudaDepthwiseConvolution)
[11/24/2022-12:09:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:28] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:28] [V] [TRT] Tactic: 254850674756030979 Time: 0.0198994
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0210233
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0209332
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0195131
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0171312
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0418171
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0317678
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0228513
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0228983
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:28] [V] [TRT] Tactic: 1899296423087490472 Time: 0.034336
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:28] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0270537
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:28] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0178909
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:28] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0160975
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:28] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0504168
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:28] [V] [TRT] Tactic: 2968605903460894194 Time: 0.023087
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0285265
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0169625
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3362537467505018070 Time: 0.026381
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0211363
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0194337
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:28] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0193331
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0355803
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0159401
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4480294673430783793 Time: 0.014896
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0163769
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0147785
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0233626
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0207086
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0158848
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0230772
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:28] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0147616
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0200486
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0211494
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5205510332404400949 Time: 0.017117
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0233861
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:28] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0236082
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:28] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0242735
[11/24/2022-12:09:28] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0194646
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0257623
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0357577
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6697277555581639516 Time: 0.016799
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0234638
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0315483
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0173907
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0213009
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0215765
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0357154
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0355054
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0235729
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0166436
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0169641
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:29] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0148059
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:29] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0232673
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0464846
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0194286
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8205952393017864204 Time: 0.016765
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0173084
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0489006
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0167868
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0417931
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0149902
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0545737
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0309915
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5530886555766748586 Time: 0.017629
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0149733
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0232216
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0273844
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0247657
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5109582882231362997 Time: 0.02112
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4950923835688973492 Time: 0.021201
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0442023
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0338231
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4379519430184503304 Time: 0.021154
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0297865
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0208653
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0369589
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0444514
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0240472
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0173917
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0187114
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0310958
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3234716536615144018 Time: 0.019092
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0187863
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0271985
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0147735
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0251124
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0223484
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0336695
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0232026
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0189263
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0264069
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0215464
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1562548049711204899 Time: 0.014885
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0344539
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0434834
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0291173
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:29] [V] [TRT] Tactic: -406984317033388136 Time: 0.0191017
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:29] [V] [TRT] Tactic: -331499326992534460 Time: 0.0198743
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:29] [V] [TRT] Tactic: -206523504474952360 Time: 0.0221714
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: 4993757826442493905 Time: 0.0147616
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4993757826442493905
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CublasConvolution)
[11/24/2022-12:09:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudaDepthwiseConvolution)
[11/24/2022-12:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:29] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0298304
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0296594
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0300946
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0263208
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0253097
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0242613
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0253707
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4443833619060044580 Time: 0.026189
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0254385
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0262689
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:29] [V] [TRT] Tactic: -108011214168778087 Time: 0.0247931
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:29] [V] [TRT] Tactic: -42427192380281294 Time: 0.0260693
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0242613
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudaDepthwiseConvolution)
[11/24/2022-12:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (FusedConvActConvolution)
[11/24/2022-12:09:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:29] [V] [TRT] Tactic: 175853789719975416 Time: 0.0184486
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0203411
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0181349
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0182823
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6299962968199310600 Time: 0.02237
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0195874
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8626990807754934295 Time: 0.01812
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0179909
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0201371
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0223536
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0181269
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:29] [V] [TRT] Tactic: -683636008127039856 Time: 0.0223118
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0179909
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:29] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0181886
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0221257
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0182446
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0223595
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8803458114157674373 Time: 0.018128
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0183149
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0186606
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0223726
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3958182351168863467 Time: 0.02024
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0202051
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0183794
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:29] [V] [TRT] Tactic: -868495160148524802 Time: 0.0182051
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.018128
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0251208
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0284716
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0293477
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0251208
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(22176,3696:32,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0296302
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0271611
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0218495
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4178917718361232468 Time: 0.027171
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0287186
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0269227
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0237002
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6969462133921577484 Time: 0.032779
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0271787
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0232007
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0281463
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0289829
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0285723
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0313865
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0344713
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0266331
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7957004747664952265 Time: 0.031936
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0288485
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0264305
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0257737
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0290523
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0229982
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0254034
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0265448
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0277737
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0295835
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0341842
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0271657
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0234469
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0310702
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0285769
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:29] [V] [TRT] Tactic: -621838502160440068 Time: 0.028173
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: 3721599319722771137 Time: 0.0218495
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3721599319722771137
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:29] [V] [TRT] Tactic: 424230345342282109 Time: 0.0176777
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0137854
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0186206
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0153138
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0187766
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0184326
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0163393
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0185349
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0142862
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0190954
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0162905
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0161818
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8142426754608472547 Time: 0.01424
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0188223
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0141531
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:29] [V] [TRT] Tactic: 9072692108481390634 Time: 0.01667
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0140289
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0163312
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0144773
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0176747
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0170966
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0159076
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0148599
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0166507
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0181697
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0146862
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3556614738549917282 Time: 0.018472
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0161219
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0207236
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0187269
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0166192
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:29] [V] [TRT] Tactic: -50323486981480818 Time: 0.016638
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: 2088124366723311762 Time: 0.0137854
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2088124366723311762
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudaGroupConvolution)
[11/24/2022-12:09:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CudaDepthwiseConvolution)
[11/24/2022-12:09:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (FusedConvActConvolution)
[11/24/2022-12:09:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_544 + node_of_545 + PWN(node_of_546) (CaskConvolution)
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:29] [V] [TRT] Tactic: 125145153013230687 Time: 0.0130016
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:29] [V] [TRT] Tactic: 1583811548148740665 Time: 0.011782
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:29] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0139212
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:29] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0158478
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0135809
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0140468
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0157833
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:29] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0166745
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0188697
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0157248
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0118041
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0118748
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0138352
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0117749
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:29] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0139408
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0165857
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0134259
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0137218
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0182309
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0161564
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0160239
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0136744
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6925201228918187099 Time: 0.013974
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:29] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0131437
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:29] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0133777
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0138011
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8173975624668590862 Time: 0.013802
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0140546
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0137164
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:29] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0140064
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:29] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0154999
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:29] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0148
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0118569
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0180994
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:29] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0158501
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0138003
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0158551
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:29] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0138622
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0139071
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0135663
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0139541
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:29] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0160813
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0157943
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0201137
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:29] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0118688
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0156709
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0117046
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:29] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0138136
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0117162
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0160422
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1328736756812546664 Time: 0.015675
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0138589
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:29] [V] [TRT] Tactic: -405554772060757402 Time: 0.0135061
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:29] [V] [TRT] Tactic: -375949437730908730 Time: 0.0138951
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:29] [V] [TRT] Tactic: -111878368089469751 Time: 0.0137509
[11/24/2022-12:09:29] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:29] [V] [TRT] Tactic: -19707840769375107 Time: 0.0136902
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: -2432868635536396215 Time: 0.0117046
[11/24/2022-12:09:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2432868635536396215
[11/24/2022-12:09:29] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:29] [V] [TRT] *************** Autotuning format combination: Float(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudaDepthwiseConvolution)
[11/24/2022-12:09:29] [V] [TRT] Tactic: -1 Time: 0.0503467
[11/24/2022-12:09:29] [V] [TRT] Fastest Tactic: -1 Time: 0.0503467
[11/24/2022-12:09:29] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudnnConvolution)
[11/24/2022-12:09:29] [V] [TRT] Tactic: 0 Time: 0.109872
[11/24/2022-12:09:29] [V] [TRT] Tactic: 1 Time: 0.109753
[11/24/2022-12:09:29] [V] [TRT] Tactic: 2 Time: 0.151067
[11/24/2022-12:09:29] [V] [TRT] Tactic: 4 Time: 23.4462
[11/24/2022-12:09:30] [V] [TRT] Tactic: 5 Time: 18.4153
[11/24/2022-12:09:30] [V] [TRT] Tactic: 6 Time: 1.92176
[11/24/2022-12:09:30] [V] [TRT] Tactic: 56 Time: 0.131063
[11/24/2022-12:09:30] [V] [TRT] Tactic: 57 Time: 0.130825
[11/24/2022-12:09:30] [V] [TRT] Tactic: 58 Time: 0.177888
[11/24/2022-12:09:30] [V] [TRT] Tactic: 60 Time: 25.2877
[11/24/2022-12:09:30] [V] [TRT] Tactic: 61 Time: 19.2292
[11/24/2022-12:09:30] [V] [TRT] Tactic: 62 Time: 1.90966
[11/24/2022-12:09:30] [V] [TRT] Tactic: 112 Time: 0.133061
[11/24/2022-12:09:30] [V] [TRT] Tactic: 113 Time: 0.134466
[11/24/2022-12:09:30] [V] [TRT] Tactic: 114 Time: 0.176827
[11/24/2022-12:09:30] [V] [TRT] Tactic: 116 Time: 25.2333
[11/24/2022-12:09:30] [V] [TRT] Tactic: 117 Time: 19.2808
[11/24/2022-12:09:30] [V] [TRT] Tactic: 118 Time: 1.94275
[11/24/2022-12:09:30] [V] [TRT] Fastest Tactic: 1 Time: 0.109753
[11/24/2022-12:09:30] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:30] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:09:30] [V] [TRT] Tactic: 130477820174479366 Time: 5.29041
[11/24/2022-12:09:30] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:09:30] [V] [TRT] Tactic: 1358952225285826925 Time: 3.23179
[11/24/2022-12:09:30] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:30] [V] [TRT] Tactic: 4549827808004681195 Time: 2.81059
[11/24/2022-12:09:30] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:09:31] [V] [TRT] Tactic: 5127140674766136213 Time: 3.25452
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:09:31] [V] [TRT] Tactic: 5691674214365884252 Time: 4.85089
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:31] [V] [TRT] Tactic: 5779835512569528575 Time: 3.71852
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:09:31] [V] [TRT] Tactic: 6053873026024413720 Time: 4.80419
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:09:31] [V] [TRT] Tactic: 6532229230713743445 Time: 5.3455
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:09:31] [V] [TRT] Tactic: 6767548733843469815 Time: 2.76905
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:09:31] [V] [TRT] Tactic: -7777264329408437990 Time: 3.35181
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:09:31] [V] [TRT] Tactic: -6693149634808211969 Time: 3.35589
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:31] [V] [TRT] Tactic: -6313876406580483184 Time: 2.52064
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:09:31] [V] [TRT] Tactic: -4932505327461806800 Time: 4.97732
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:09:31] [V] [TRT] Tactic: -2870780723387717246 Time: 3.7073
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:31] [V] [TRT] Tactic: -1123676555321336786 Time: 3.70186
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:31] [V] [TRT] Tactic: -701551393537224327 Time: 2.83039
[11/24/2022-12:09:31] [V] [TRT] Fastest Tactic: -6313876406580483184 Time: 2.52064
[11/24/2022-12:09:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:09:31] [V] [TRT] *************** Autotuning format combination: Float(709632,1,16128,192) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:09:31] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:09:31] [V] [TRT] Tactic: 1852818056038333088 Time: 4.85209
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:09:31] [V] [TRT] Tactic: 2137271960938803767 Time: 4.46679
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:09:31] [V] [TRT] Tactic: 4543151729465212056 Time: 17.8929
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:09:31] [V] [TRT] Tactic: 5778138195697110002 Time: 4.64194
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:09:31] [V] [TRT] Tactic: 7098622778606028509 Time: 4.53641
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:09:31] [V] [TRT] Tactic: -9217704540809507511 Time: 5.42129
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:09:31] [V] [TRT] Tactic: -7734972403155710907 Time: 4.46126
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:09:31] [V] [TRT] Tactic: -3855385237722507463 Time: 4.72807
[11/24/2022-12:09:31] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:09:32] [V] [TRT] Tactic: -3360299822783115645 Time: 7.58398
[11/24/2022-12:09:32] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:09:32] [V] [TRT] Tactic: -2809379259463049392 Time: 4.67586
[11/24/2022-12:09:32] [V] [TRT] node_of_547 + node_of_548 + PWN(node_of_549) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:09:32] [V] [TRT] Tactic: -824800713406371346 Time: 4.42336
[11/24/2022-12:09:32] [V] [TRT] Fastest Tactic: -824800713406371346 Time: 4.42336
[11/24/2022-12:09:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -824800713406371346
[11/24/2022-12:09:32] [V] [TRT] *************** Autotuning format combination: Float(177408,1:4,4032,48) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:09:32] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:32] [V] [TRT] *************** Autotuning format combination: Half(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:32] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudnnConvolution)
[11/24/2022-12:09:32] [V] [TRT] Tactic: 0 Time: 0.069501
[11/24/2022-12:09:32] [V] [TRT] Tactic: 1 Time: 0.0687375
[11/24/2022-12:09:32] [V] [TRT] Tactic: 2 Time: 0.12805
[11/24/2022-12:09:32] [V] [TRT] Tactic: 4 Time: 25.5998
[11/24/2022-12:09:32] [V] [TRT] Tactic: 5 Time: 19.2477
[11/24/2022-12:09:32] [V] [TRT] Tactic: 6 Time: 8.31061
[11/24/2022-12:09:32] [V] [TRT] Tactic: 56 Time: 0.0687162
[11/24/2022-12:09:32] [V] [TRT] Tactic: 58 Time: 0.128651
[11/24/2022-12:09:32] [V] [TRT] Tactic: 60 Time: 25.6827
[11/24/2022-12:09:32] [V] [TRT] Tactic: 61 Time: 19.1923
[11/24/2022-12:09:33] [V] [TRT] Tactic: 62 Time: 8.22244
[11/24/2022-12:09:33] [V] [TRT] Fastest Tactic: 56 Time: 0.0687162
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Half(354816,3696:2,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudaDepthwiseConvolution)
[11/24/2022-12:09:33] [V] [TRT] Tactic: -2 Time: 0.0284846
[11/24/2022-12:09:33] [V] [TRT] Fastest Tactic: -2 Time: 0.0284846
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Half(44352,1:16,1008,12) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Half(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudaDepthwiseConvolution)
[11/24/2022-12:09:33] [V] [TRT] Tactic: -5 Time: 0.28768
[11/24/2022-12:09:33] [V] [TRT] Fastest Tactic: -5 Time: 0.28768
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudaDepthwiseConvolution)
[11/24/2022-12:09:33] [V] [TRT] Tactic: -3 Time: 0.0181983
[11/24/2022-12:09:33] [V] [TRT] Fastest Tactic: -3 Time: 0.0181983
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Float(22176,3696:32,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudaGroupConvolution)
[11/24/2022-12:09:33] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CudaDepthwiseConvolution)
[11/24/2022-12:09:33] [V] [TRT] Tactic: -4 Time: 0.0177773
[11/24/2022-12:09:33] [V] [TRT] Tactic: 0 Time: 0.0181537
[11/24/2022-12:09:33] [V] [TRT] Tactic: 1 Time: 0.0182394
[11/24/2022-12:09:33] [V] [TRT] Tactic: 2 Time: 0.018028
[11/24/2022-12:09:33] [V] [TRT] Tactic: 3 Time: 0.0181817
[11/24/2022-12:09:33] [V] [TRT] Tactic: 4 Time: 0.0202657
[11/24/2022-12:09:33] [V] [TRT] Tactic: 5 Time: 0.0178749
[11/24/2022-12:09:33] [V] [TRT] Tactic: 6 Time: 0.031467
[11/24/2022-12:09:33] [V] [TRT] Tactic: 7 Time: 0.0234978
[11/24/2022-12:09:33] [V] [TRT] Tactic: 8 Time: 0.0369943
[11/24/2022-12:09:33] [V] [TRT] Tactic: 9 Time: 0.0340919
[11/24/2022-12:09:33] [V] [TRT] Tactic: 10 Time: 0.0180269
[11/24/2022-12:09:33] [V] [TRT] Tactic: 11 Time: 0.0177656
[11/24/2022-12:09:33] [V] [TRT] Tactic: 12 Time: 0.0179023
[11/24/2022-12:09:33] [V] [TRT] Tactic: 13 Time: 0.0179217
[11/24/2022-12:09:33] [V] [TRT] Tactic: 14 Time: 0.0202966
[11/24/2022-12:09:33] [V] [TRT] Tactic: 15 Time: 0.0182577
[11/24/2022-12:09:33] [V] [TRT] Tactic: 16 Time: 0.0313399
[11/24/2022-12:09:33] [V] [TRT] Tactic: 17 Time: 0.025984
[11/24/2022-12:09:33] [V] [TRT] Tactic: 18 Time: 0.0369954
[11/24/2022-12:09:33] [V] [TRT] Tactic: 19 Time: 0.0340078
[11/24/2022-12:09:33] [V] [TRT] Tactic: 20 Time: 0.0205185
[11/24/2022-12:09:33] [V] [TRT] Tactic: 21 Time: 0.0177427
[11/24/2022-12:09:33] [V] [TRT] Tactic: 22 Time: 0.0206158
[11/24/2022-12:09:33] [V] [TRT] Tactic: 23 Time: 0.0178697
[11/24/2022-12:09:33] [V] [TRT] Tactic: 24 Time: 0.024317
[11/24/2022-12:09:33] [V] [TRT] Tactic: 25 Time: 0.0180177
[11/24/2022-12:09:33] [V] [TRT] Tactic: 26 Time: 0.0316891
[11/24/2022-12:09:33] [V] [TRT] Tactic: 27 Time: 0.0258949
[11/24/2022-12:09:33] [V] [TRT] Tactic: 28 Time: 0.0372217
[11/24/2022-12:09:33] [V] [TRT] Tactic: 29 Time: 0.0340928
[11/24/2022-12:09:33] [V] [TRT] Tactic: 30 Time: 0.0181451
[11/24/2022-12:09:33] [V] [TRT] Tactic: 31 Time: 0.017944
[11/24/2022-12:09:33] [V] [TRT] Tactic: 32 Time: 0.0179086
[11/24/2022-12:09:33] [V] [TRT] Tactic: 33 Time: 0.0179389
[11/24/2022-12:09:33] [V] [TRT] Tactic: 34 Time: 0.0179394
[11/24/2022-12:09:33] [V] [TRT] Tactic: 35 Time: 0.0179651
[11/24/2022-12:09:33] [V] [TRT] Tactic: 36 Time: 0.0286007
[11/24/2022-12:09:33] [V] [TRT] Tactic: 37 Time: 0.0228219
[11/24/2022-12:09:33] [V] [TRT] Tactic: 38 Time: 0.0366526
[11/24/2022-12:09:33] [V] [TRT] Tactic: 39 Time: 0.0312759
[11/24/2022-12:09:33] [V] [TRT] Tactic: 40 Time: 0.0155424
[11/24/2022-12:09:33] [V] [TRT] Tactic: 41 Time: 0.0170585
[11/24/2022-12:09:33] [V] [TRT] Tactic: 42 Time: 0.0179606
[11/24/2022-12:09:33] [V] [TRT] Tactic: 43 Time: 0.0154519
[11/24/2022-12:09:33] [V] [TRT] Tactic: 44 Time: 0.017984
[11/24/2022-12:09:33] [V] [TRT] Tactic: 45 Time: 0.0178499
[11/24/2022-12:09:33] [V] [TRT] Tactic: 46 Time: 0.0287643
[11/24/2022-12:09:33] [V] [TRT] Tactic: 47 Time: 0.0232411
[11/24/2022-12:09:33] [V] [TRT] Tactic: 48 Time: 0.0367109
[11/24/2022-12:09:33] [V] [TRT] Tactic: 49 Time: 0.0312503
[11/24/2022-12:09:33] [V] [TRT] Tactic: 50 Time: 0.0179749
[11/24/2022-12:09:33] [V] [TRT] Tactic: 51 Time: 0.0153829
[11/24/2022-12:09:33] [V] [TRT] Tactic: 52 Time: 0.0196503
[11/24/2022-12:09:33] [V] [TRT] Tactic: 53 Time: 0.0154048
[11/24/2022-12:09:33] [V] [TRT] Tactic: 54 Time: 0.0232751
[11/24/2022-12:09:33] [V] [TRT] Tactic: 55 Time: 0.0178448
[11/24/2022-12:09:33] [V] [TRT] Tactic: 56 Time: 0.0298843
[11/24/2022-12:09:33] [V] [TRT] Tactic: 57 Time: 0.0231491
[11/24/2022-12:09:33] [V] [TRT] Tactic: 58 Time: 0.0368377
[11/24/2022-12:09:33] [V] [TRT] Tactic: 59 Time: 0.030752
[11/24/2022-12:09:33] [V] [TRT] Fastest Tactic: 51 Time: 0.0153829
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_547 + node_of_548 + PWN(node_of_549) (CaskConvolution)
[11/24/2022-12:09:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 51
[11/24/2022-12:09:33] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:33] [V] [TRT] *************** Autotuning format combination: Float(709632,3696,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudaDepthwiseConvolution)
[11/24/2022-12:09:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (FusedConvActConvolution)
[11/24/2022-12:09:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:33] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudnnConvolution)
[11/24/2022-12:09:33] [V] [TRT] Tactic: 0 Time: 0.0632518
[11/24/2022-12:09:33] [V] [TRT] Tactic: 1 Time: 0.0627109
[11/24/2022-12:09:33] [V] [TRT] Tactic: 2 Time: 0.255474
[11/24/2022-12:09:34] [V] [TRT] Tactic: 4 Time: 79.1938
[11/24/2022-12:09:34] [V] [TRT] Tactic: 5 Time: 0.298217
[11/24/2022-12:09:34] [V] [TRT] Tactic: 56 Time: 0.0625874
[11/24/2022-12:09:34] [V] [TRT] Tactic: 57 Time: 0.0685608
[11/24/2022-12:09:34] [V] [TRT] Tactic: 58 Time: 0.256489
[11/24/2022-12:09:34] [V] [TRT] Tactic: 60 Time: 68.4167
[11/24/2022-12:09:35] [V] [TRT] Tactic: 61 Time: 0.246578
[11/24/2022-12:09:35] [V] [TRT] Tactic: 112 Time: 0.0563596
[11/24/2022-12:09:35] [V] [TRT] Tactic: 113 Time: 0.0587977
[11/24/2022-12:09:35] [V] [TRT] Tactic: 114 Time: 0.214674
[11/24/2022-12:09:35] [V] [TRT] Tactic: 116 Time: 58.9474
[11/24/2022-12:09:35] [V] [TRT] Tactic: 117 Time: 0.245819
[11/24/2022-12:09:35] [V] [TRT] Fastest Tactic: 112 Time: 0.0563596
[11/24/2022-12:09:35] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:35] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:35] [V] [TRT] Tactic: 621442388677115936 Time: 0.0653775
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:35] [V] [TRT] Tactic: 697756878388249475 Time: 0.036824
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:35] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0366377
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:35] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0424891
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:35] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0542171
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:35] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0757349
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:35] [V] [TRT] Tactic: 3377996665278764661 Time: 0.185568
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:35] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0412697
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:35] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0492251
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:35] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0584914
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:35] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0778468
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:35] [V] [TRT] Tactic: 5837905844602864231 Time: 0.052093
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0705402
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0311927
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0443291
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0298213
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0629912
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0466274
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:35] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0888206
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:35] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0404697
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:35] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0732731
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:35] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0548419
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:35] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0514667
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:35] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0507368
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:35] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0879451
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:35] [V] [TRT] Tactic: -7070045993088702524 Time: 0.166985
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:35] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0396423
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:35] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0542583
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:35] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0771634
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:35] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0878811
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:35] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0470789
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:35] [V] [TRT] Tactic: -2777237991111865351 Time: 0.109415
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:35] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0483185
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:35] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0515048
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:35] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0777234
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:35] [V] [TRT] Tactic: -701551393537224327 Time: 0.049373
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:35] [V] [TRT] Tactic: -3258434593395023 Time: 0.108325
[11/24/2022-12:09:35] [V] [TRT] Fastest Tactic: 6723161876874263939 Time: 0.0298213
[11/24/2022-12:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6723161876874263939
[11/24/2022-12:09:35] [V] [TRT] *************** Autotuning format combination: Float(709632,1,16128,192), Float(118272,1,2688,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:09:35] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:35] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:35] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0749166
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:35] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0713051
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:35] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0510263
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:35] [V] [TRT] Tactic: 3887292144336338310 Time: 0.042008
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:35] [V] [TRT] Tactic: 4474630279712975759 Time: 0.035381
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:35] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0341257
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:35] [V] [TRT] Tactic: 4696204239951173149 Time: 0.050976
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:35] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0796503
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:35] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0437669
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:35] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0710232
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:35] [V] [TRT] Tactic: -8031737312007363273 Time: 0.043592
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:35] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0479116
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:35] [V] [TRT] Tactic: -4896615592193611463 Time: 0.05904
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:35] [V] [TRT] Tactic: -4056705536979434560 Time: 0.072864
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:35] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0301614
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:35] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0417474
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:35] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0786857
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:35] [V] [TRT] Tactic: -1985235291706575900 Time: 0.075776
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:35] [V] [TRT] Tactic: -504296718212024303 Time: 0.0765554
[11/24/2022-12:09:35] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0301614
[11/24/2022-12:09:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:09:35] [V] [TRT] *************** Autotuning format combination: Float(177408,1:4,4032,48), Float(29568,1:4,672,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:09:35] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:35] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:35] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0266415
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:35] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0203394
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:35] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0228996
[11/24/2022-12:09:35] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:36] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0300553
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:36] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0239147
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:36] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0230903
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:36] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0338258
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:36] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0252427
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:36] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0426617
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:36] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0364229
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:36] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0268876
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:36] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0265356
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:36] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0256503
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:36] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0281387
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:36] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0255558
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:36] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0365794
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:36] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0307995
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:36] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0417931
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:36] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0258149
[11/24/2022-12:09:36] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:36] [V] [TRT] Tactic: -1138876066247138089 Time: 0.025792
[11/24/2022-12:09:36] [V] [TRT] Fastest Tactic: 2536540085349545921 Time: 0.0203394
[11/24/2022-12:09:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2536540085349545921
[11/24/2022-12:09:36] [V] [TRT] *************** Autotuning format combination: Half(709632,3696,84,1), Half(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:09:36] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudnnConvolution)
[11/24/2022-12:09:36] [V] [TRT] Tactic: 0 Time: 0.0521463
[11/24/2022-12:09:36] [V] [TRT] Tactic: 1 Time: 0.0663878
[11/24/2022-12:09:36] [V] [TRT] Tactic: 2 Time: 0.215296
[11/24/2022-12:09:36] [V] [TRT] Tactic: 4 Time: 58.9099
[11/24/2022-12:09:36] [V] [TRT] Tactic: 5 Time: 0.215657
[11/24/2022-12:09:36] [V] [TRT] Tactic: 56 Time: 0.0509272
[11/24/2022-12:09:36] [V] [TRT] Tactic: 58 Time: 0.211653
[11/24/2022-12:09:37] [V] [TRT] Tactic: 60 Time: 58.8806
[11/24/2022-12:09:37] [V] [TRT] Tactic: 61 Time: 0.216041
[11/24/2022-12:09:37] [V] [TRT] Fastest Tactic: 56 Time: 0.0509272
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Half(354816,3696:2,84,1), Half(59136,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (FusedConvActConvolution)
[11/24/2022-12:09:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24), Half(14784,1:8,336,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudaDepthwiseConvolution)
[11/24/2022-12:09:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:37] [V] [TRT] Tactic: 254850674756030979 Time: 0.0158893
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0160432
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0130506
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0168686
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0155378
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0287351
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0167492
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0138502
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0307118
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0179857
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0201457
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0158827
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0244457
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0256876
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0138772
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0131632
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0108839
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0202634
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0177813
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0160472
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0136353
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0261143
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4370476717970497892 Time: 0.00991787
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0116132
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0139154
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0113596
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0136723
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0162926
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4595173549602041350 Time: 0.024269
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0139188
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0116051
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0158469
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0160752
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0157897
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0180543
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0138876
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0187263
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0158847
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0200223
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6468794451065529747 Time: 0.017936
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0161117
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0314286
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0178966
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:37] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0158796
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:37] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0136756
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0119775
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0181594
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0179789
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0139038
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0114898
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0155438
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:37] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00967101
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:37] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0142176
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0243596
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0158679
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0141868
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0117851
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:37] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0243947
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:37] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0175817
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:37] [V] [TRT] Tactic: -7089118800560870395 Time: 0.022319
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:37] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0147328
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:37] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0265112
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:37] [V] [TRT] Tactic: -6063766379489217211 Time: 0.016034
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0157998
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00974964
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0135817
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5161596964442251102 Time: 0.020312
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5127240325355316006 Time: 0.018764
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0162682
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0139158
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0303671
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0180143
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0136869
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0168076
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0161747
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0264533
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3987638434926559037 Time: 0.030613
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0147077
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0137725
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0137829
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3601464762214218301 Time: 0.017924
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0121272
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0157047
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0203206
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:37] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0114258
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:37] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0198366
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:37] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0138282
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:37] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0172891
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:37] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0182971
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0139271
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0121539
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0138215
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0152759
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0246415
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0223386
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1038291877007553549 Time: 0.015902
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:37] [V] [TRT] Tactic: -406984317033388136 Time: 0.0159431
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:37] [V] [TRT] Tactic: -331499326992534460 Time: 0.013381
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:37] [V] [TRT] Tactic: -206523504474952360 Time: 0.0178771
[11/24/2022-12:09:37] [V] [TRT] Fastest Tactic: -9203179519031456182 Time: 0.00967101
[11/24/2022-12:09:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9203179519031456182
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Half(44352,1:16,1008,12), Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Half(22176,3696:32,84,1), Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CublasConvolution)
[11/24/2022-12:09:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudaDepthwiseConvolution)
[11/24/2022-12:09:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1508480131241957639 Time: 0.034891
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0348864
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0348407
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5592640619112287921 Time: 0.018132
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:37] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0241204
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:37] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0187571
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0243337
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4443833619060044580 Time: 0.018084
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:37] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0202029
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0185783
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:37] [V] [TRT] Tactic: -108011214168778087 Time: 0.0200857
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:37] [V] [TRT] Tactic: -42427192380281294 Time: 0.0224477
[11/24/2022-12:09:37] [V] [TRT] Fastest Tactic: -4443833619060044580 Time: 0.018084
[11/24/2022-12:09:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4443833619060044580
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1), Int8(29568,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudaDepthwiseConvolution)
[11/24/2022-12:09:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (FusedConvActConvolution)
[11/24/2022-12:09:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:37] [V] [TRT] Tactic: 175853789719975416 Time: 0.018
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0163215
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0215543
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0221303
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0309449
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0158974
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0178057
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0203737
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:37] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0158327
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:37] [V] [TRT] Tactic: -6585664687867083638 Time: 0.030837
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0164358
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:37] [V] [TRT] Tactic: -683636008127039856 Time: 0.0311881
[11/24/2022-12:09:37] [V] [TRT] Fastest Tactic: -7303593854972602201 Time: 0.0158327
[11/24/2022-12:09:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7303593854972602201
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1), Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:37] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0178555
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0307547
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0207863
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0305874
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0202949
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:37] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0161752
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0158501
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:37] [V] [TRT] Tactic: -4255737803793506479 Time: 0.030752
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0157966
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:37] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0159716
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:37] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0178545
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:37] [V] [TRT] Tactic: -868495160148524802 Time: 0.0201914
[11/24/2022-12:09:37] [V] [TRT] Fastest Tactic: -3958182351168863467 Time: 0.0157966
[11/24/2022-12:09:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3958182351168863467
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0116796
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0118871
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:37] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0117655
[11/24/2022-12:09:37] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0116796
[11/24/2022-12:09:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:09:37] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Float(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:09:37] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0111961
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:37] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0108428
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:37] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00961493
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:37] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0126629
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:37] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0158281
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0159294
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0118069
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:37] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0182789
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:37] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0119015
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:37] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0118688
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:37] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0136233
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:37] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00992213
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0139084
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0115073
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:37] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0118896
[11/24/2022-12:09:37] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0157975
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0178971
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7904635102498369361 Time: 0.015835
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0115189
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0133132
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0158624
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00959543
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0116353
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0135551
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5416590980288859834 Time: 0.015873
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:38] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0116448
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0136029
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0132039
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0131429
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:38] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0122244
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0136096
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:38] [V] [TRT] Tactic: -621838502160440068 Time: 0.0136399
[11/24/2022-12:09:38] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.00959543
[11/24/2022-12:09:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:38] [V] [TRT] Tactic: 424230345342282109 Time: 0.0135992
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:38] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00953629
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:38] [V] [TRT] Tactic: 2327398338581585326 Time: 0.015902
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:38] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0113962
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:38] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0157915
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:38] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0120103
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0118446
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0158286
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00995596
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0158167
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0137297
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7796695344726998947 Time: 0.013617
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0118477
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0104891
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00975878
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:38] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0118622
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:38] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0116934
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:38] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00896057
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:38] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0112647
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0136029
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0134483
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0115819
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0181994
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0120613
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00926314
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3773982102975252832 Time: 0.009824
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0158386
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0198343
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:38] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0105466
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0158021
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0134117
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:38] [V] [TRT] Tactic: -50323486981480818 Time: 0.0128564
[11/24/2022-12:09:38] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.00896057
[11/24/2022-12:09:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudaGroupConvolution)
[11/24/2022-12:09:38] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CudaDepthwiseConvolution)
[11/24/2022-12:09:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (FusedConvActConvolution)
[11/24/2022-12:09:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_550 + node_of_551 + node_of_552 (CaskConvolution)
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:38] [V] [TRT] Tactic: 125145153013230687 Time: 0.0176462
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:38] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0176122
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:38] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0148905
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:38] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0100389
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:38] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0102116
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:38] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0149115
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:38] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0122339
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:38] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0125474
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:38] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0117746
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:38] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0149399
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:38] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0119867
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:38] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0110203
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:38] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0145294
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:38] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00998217
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:38] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0147397
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6007888770437705057 Time: 0.017725
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0119669
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0113948
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0126293
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0228454
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0149422
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0124263
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0127017
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:38] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0177747
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:38] [V] [TRT] Tactic: 7318929579222925725 Time: 0.012128
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8142283985160822229 Time: 0.012445
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0201526
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0125528
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0148078
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:38] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0148741
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:38] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0146624
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:38] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0147721
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0120065
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00938914
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:38] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0176564
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0149211
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0172637
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:38] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0129516
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:38] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0120347
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:38] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0161178
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:38] [V] [TRT] Tactic: -4182501876984672402 Time: 0.015099
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:38] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0233182
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00941
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0118432
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:38] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0173562
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:38] [V] [TRT] Tactic: -2754311112012636251 Time: 0.009568
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:38] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0169788
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:38] [V] [TRT] Tactic: -2315453944962430928 Time: 0.020465
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0174857
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1549742793039499659 Time: 0.017757
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0150624
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0096832
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:38] [V] [TRT] Tactic: -405554772060757402 Time: 0.0119585
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:38] [V] [TRT] Tactic: -375949437730908730 Time: 0.0114247
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:38] [V] [TRT] Tactic: -111878368089469751 Time: 0.0152434
[11/24/2022-12:09:38] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:38] [V] [TRT] Tactic: -19707840769375107 Time: 0.0095741
[11/24/2022-12:09:38] [V] [TRT] Fastest Tactic: -6510232214299595844 Time: 0.00938914
[11/24/2022-12:09:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6510232214299595844
[11/24/2022-12:09:38] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(709632,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(709632,1,16128,192) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(177408,1:4,4032,48) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(709632,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(354816,3696:2,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(44352,1:16,1008,12) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Float(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(709632,3696,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(709632,1,16128,192), Float(118272,1,2688,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(177408,1:4,4032,48), Float(29568,1:4,672,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(709632,3696,84,1), Half(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(354816,3696:2,84,1), Half(59136,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24), Half(14784,1:8,336,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(44352,1:16,1008,12), Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(22176,3696:32,84,1), Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1), Int8(29568,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1), Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Float(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1), Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(709632,1,16128,192) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(177408,1:4,4032,48) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(354816,3696:2,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(88704,1:8,2016,24) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(44352,1:16,1008,12) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(177408,3696:4,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(709632,3696,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(22176,3696:32,84,1) ***************
[11/24/2022-12:09:38] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:38] [V] [TRT] *************** Autotuning format combination: Float(709632,3696,84,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudaDepthwiseConvolution)
[11/24/2022-12:09:38] [V] [TRT] Tactic: -1 Time: 0.0337289
[11/24/2022-12:09:38] [V] [TRT] Fastest Tactic: -1 Time: 0.0337289
[11/24/2022-12:09:38] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudnnConvolution)
[11/24/2022-12:09:38] [V] [TRT] Tactic: 0 Time: 0.046376
[11/24/2022-12:09:38] [V] [TRT] Tactic: 1 Time: 0.0463989
[11/24/2022-12:09:38] [V] [TRT] Tactic: 2 Time: 0.0524206
[11/24/2022-12:09:38] [V] [TRT] Tactic: 5 Time: 19.4847
[11/24/2022-12:09:38] [V] [TRT] Tactic: 56 Time: 0.0612785
[11/24/2022-12:09:38] [V] [TRT] Tactic: 57 Time: 0.0561554
[11/24/2022-12:09:38] [V] [TRT] Tactic: 58 Time: 0.0476754
[11/24/2022-12:09:38] [V] [TRT] Tactic: 61 Time: 19.4433
[11/24/2022-12:09:38] [V] [TRT] Tactic: 112 Time: 0.0530712
[11/24/2022-12:09:38] [V] [TRT] Tactic: 113 Time: 0.060771
[11/24/2022-12:09:38] [V] [TRT] Tactic: 114 Time: 0.0520762
[11/24/2022-12:09:39] [V] [TRT] Tactic: 117 Time: 19.4512
[11/24/2022-12:09:39] [V] [TRT] Fastest Tactic: 0 Time: 0.046376
[11/24/2022-12:09:39] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:09:39] [V] [TRT] Tactic: 130477820174479366 Time: 2.41872
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:09:39] [V] [TRT] Tactic: 1358952225285826925 Time: 2.61152
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:39] [V] [TRT] Tactic: 4549827808004681195 Time: 2.32398
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:09:39] [V] [TRT] Tactic: 5127140674766136213 Time: 1.69097
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:09:39] [V] [TRT] Tactic: 5691674214365884252 Time: 4.81105
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:39] [V] [TRT] Tactic: 5779835512569528575 Time: 2.71037
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:09:39] [V] [TRT] Tactic: 6053873026024413720 Time: 2.68454
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:09:39] [V] [TRT] Tactic: 6532229230713743445 Time: 2.3469
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:09:39] [V] [TRT] Tactic: 6767548733843469815 Time: 2.36697
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:09:39] [V] [TRT] Tactic: -6693149634808211969 Time: 1.71753
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:39] [V] [TRT] Tactic: -6313876406580483184 Time: 2.38265
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:09:39] [V] [TRT] Tactic: -4932505327461806800 Time: 4.86118
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:09:39] [V] [TRT] Tactic: -2870780723387717246 Time: 1.83344
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:39] [V] [TRT] Tactic: -1123676555321336786 Time: 2.71106
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:39] [V] [TRT] Tactic: -701551393537224327 Time: 2.41183
[11/24/2022-12:09:39] [V] [TRT] Fastest Tactic: 5127140674766136213 Time: 1.69097
[11/24/2022-12:09:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:09:39] [V] [TRT] *************** Autotuning format combination: Float(709632,1,16128,192) -> Float(177408,1,8064,192) ***************
[11/24/2022-12:09:39] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:09:39] [V] [TRT] Tactic: 1852818056038333088 Time: 2.33857
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:09:39] [V] [TRT] Tactic: 2137271960938803767 Time: 3.22143
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:09:39] [V] [TRT] Tactic: 4543151729465212056 Time: 6.39099
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:09:39] [V] [TRT] Tactic: 5778138195697110002 Time: 1.28171
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:09:39] [V] [TRT] Tactic: 7098622778606028509 Time: 2.25464
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:09:39] [V] [TRT] Tactic: -9217704540809507511 Time: 5.3902
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:09:39] [V] [TRT] Tactic: -7734972403155710907 Time: 2.25688
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:09:39] [V] [TRT] Tactic: -3855385237722507463 Time: 1.31958
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:09:39] [V] [TRT] Tactic: -3360299822783115645 Time: 3.25846
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:09:39] [V] [TRT] Tactic: -2809379259463049392 Time: 1.29195
[11/24/2022-12:09:39] [V] [TRT] node_of_565 + node_of_566 + PWN(node_of_567) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:09:39] [V] [TRT] Tactic: -824800713406371346 Time: 3.14426
[11/24/2022-12:09:39] [V] [TRT] Fastest Tactic: 5778138195697110002 Time: 1.28171
[11/24/2022-12:09:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5778138195697110002
[11/24/2022-12:09:39] [V] [TRT] *************** Autotuning format combination: Float(177408,1:4,4032,48) -> Float(44352,1:4,2016,48) ***************
[11/24/2022-12:09:39] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:39] [V] [TRT] *************** Autotuning format combination: Half(709632,3696,84,1) -> Half(177408,924,42,1) ***************
[11/24/2022-12:09:39] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudnnConvolution)
[11/24/2022-12:09:39] [V] [TRT] Tactic: 0 Time: 0.0449897
[11/24/2022-12:09:39] [V] [TRT] Tactic: 1 Time: 0.0451543
[11/24/2022-12:09:39] [V] [TRT] Tactic: 2 Time: 0.0439977
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5 Time: 19.4562
[11/24/2022-12:09:40] [V] [TRT] Tactic: 56 Time: 0.0448366
[11/24/2022-12:09:40] [V] [TRT] Tactic: 58 Time: 0.0442137
[11/24/2022-12:09:40] [V] [TRT] Tactic: 61 Time: 19.4034
[11/24/2022-12:09:40] [V] [TRT] Fastest Tactic: 2 Time: 0.0439977
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Half(354816,3696:2,84,1) -> Half(88704,924:2,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24) -> Float(177408,924,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Half(88704,1:8,2016,24) -> Half(22176,1:8,1008,24) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudaDepthwiseConvolution)
[11/24/2022-12:09:40] [V] [TRT] Tactic: -2 Time: 0.0158867
[11/24/2022-12:09:40] [V] [TRT] Fastest Tactic: -2 Time: 0.0158867
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Half(44352,1:16,1008,12) -> Half(11088,1:16,504,12) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Half(22176,3696:32,84,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudaDepthwiseConvolution)
[11/24/2022-12:09:40] [V] [TRT] Tactic: -5 Time: 0.0587063
[11/24/2022-12:09:40] [V] [TRT] Fastest Tactic: -5 Time: 0.0587063
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Int8(44352,924:4,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudaDepthwiseConvolution)
[11/24/2022-12:09:40] [V] [TRT] Tactic: -3 Time: 0.0117545
[11/24/2022-12:09:40] [V] [TRT] Fastest Tactic: -3 Time: 0.0117545
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(177408,3696:4,84,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Float(177408,924,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Float(5544,924:32,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Half(5544,924:32,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:32,84,1) -> Int8(5544,924:32,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudaGroupConvolution)
[11/24/2022-12:09:40] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CudaDepthwiseConvolution)
[11/24/2022-12:09:40] [V] [TRT] Tactic: -4 Time: 0.00949314
[11/24/2022-12:09:40] [V] [TRT] Tactic: 0 Time: 0.0123425
[11/24/2022-12:09:40] [V] [TRT] Tactic: 1 Time: 0.0145225
[11/24/2022-12:09:40] [V] [TRT] Tactic: 2 Time: 0.0147493
[11/24/2022-12:09:40] [V] [TRT] Tactic: 3 Time: 0.0124796
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4 Time: 0.0201646
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5 Time: 0.0179834
[11/24/2022-12:09:40] [V] [TRT] Tactic: 6 Time: 0.0258994
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7 Time: 0.0258095
[11/24/2022-12:09:40] [V] [TRT] Tactic: 8 Time: 0.0414251
[11/24/2022-12:09:40] [V] [TRT] Tactic: 9 Time: 0.0402057
[11/24/2022-12:09:40] [V] [TRT] Tactic: 10 Time: 0.0120998
[11/24/2022-12:09:40] [V] [TRT] Tactic: 11 Time: 0.0123147
[11/24/2022-12:09:40] [V] [TRT] Tactic: 12 Time: 0.0146789
[11/24/2022-12:09:40] [V] [TRT] Tactic: 13 Time: 0.0127002
[11/24/2022-12:09:40] [V] [TRT] Tactic: 14 Time: 0.0204297
[11/24/2022-12:09:40] [V] [TRT] Tactic: 15 Time: 0.0179909
[11/24/2022-12:09:40] [V] [TRT] Tactic: 16 Time: 0.0261562
[11/24/2022-12:09:40] [V] [TRT] Tactic: 17 Time: 0.0259467
[11/24/2022-12:09:40] [V] [TRT] Tactic: 18 Time: 0.04212
[11/24/2022-12:09:40] [V] [TRT] Tactic: 19 Time: 0.0397509
[11/24/2022-12:09:40] [V] [TRT] Tactic: 20 Time: 0.012533
[11/24/2022-12:09:40] [V] [TRT] Tactic: 21 Time: 0.012248
[11/24/2022-12:09:40] [V] [TRT] Tactic: 22 Time: 0.015259
[11/24/2022-12:09:40] [V] [TRT] Tactic: 23 Time: 0.0125291
[11/24/2022-12:09:40] [V] [TRT] Tactic: 24 Time: 0.0231843
[11/24/2022-12:09:40] [V] [TRT] Tactic: 25 Time: 0.0180371
[11/24/2022-12:09:40] [V] [TRT] Tactic: 26 Time: 0.0261783
[11/24/2022-12:09:40] [V] [TRT] Tactic: 27 Time: 0.0257341
[11/24/2022-12:09:40] [V] [TRT] Tactic: 28 Time: 0.0420217
[11/24/2022-12:09:40] [V] [TRT] Tactic: 29 Time: 0.0394743
[11/24/2022-12:09:40] [V] [TRT] Fastest Tactic: -4 Time: 0.00949314
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_565 + node_of_566 + PWN(node_of_567) (CaskConvolution)
[11/24/2022-12:09:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -4
[11/24/2022-12:09:40] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:40] [V] [TRT] *************** Autotuning format combination: Float(177408,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudaDepthwiseConvolution)
[11/24/2022-12:09:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (FusedConvActConvolution)
[11/24/2022-12:09:40] [V] [TRT] Tactic: 589823 Time: 0.0696168
[11/24/2022-12:09:40] [V] [TRT] Tactic: 655359 Time: 0.0509729
[11/24/2022-12:09:40] [V] [TRT] Tactic: 786431 Time: 0.0345701
[11/24/2022-12:09:40] [V] [TRT] Tactic: 851967 Time: 0.0414091
[11/24/2022-12:09:40] [V] [TRT] Tactic: 1179647 Time: 0.0326921
[11/24/2022-12:09:40] [V] [TRT] Tactic: 1638399 Time: 0.0369531
[11/24/2022-12:09:40] [V] [TRT] Tactic: 2097151 Time: 0.0366617
[11/24/2022-12:09:40] [V] [TRT] Tactic: 3538943 Time: 0.0313509
[11/24/2022-12:09:40] [V] [TRT] Tactic: 3932159 Time: 0.0472949
[11/24/2022-12:09:40] [V] [TRT] Tactic: 3997695 Time: 0.0346615
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4194303 Time: 0.034784
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4259839 Time: 0.036304
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4587519 Time: 0.0340882
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4653055 Time: 0.0335305
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4915199 Time: 0.0341248
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4980735 Time: 0.0367714
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5177343 Time: 0.0336686
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5242879 Time: 0.034059
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5373951 Time: 0.0365463
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5570559 Time: 0.0393097
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5767167 Time: 0.0658011
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5898239 Time: 0.0341349
[11/24/2022-12:09:40] [V] [TRT] Tactic: 6225919 Time: 0.0316974
[11/24/2022-12:09:40] [V] [TRT] Tactic: 6291455 Time: 0.033088
[11/24/2022-12:09:40] [V] [TRT] Tactic: 6815743 Time: 0.0369143
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7012351 Time: 0.036592
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7077887 Time: 0.0339557
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7143423 Time: 0.0526507
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7208959 Time: 0.0368811
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7340031 Time: 0.0367006
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7536639 Time: 0.0449794
[11/24/2022-12:09:40] [V] [TRT] Tactic: 7733247 Time: 0.0342656
[11/24/2022-12:09:40] [V] [TRT] Tactic: 8191999 Time: 0.0399177
[11/24/2022-12:09:40] [V] [TRT] Tactic: 8716287 Time: 0.0340553
[11/24/2022-12:09:40] [V] [TRT] Tactic: 9109503 Time: 0.039248
[11/24/2022-12:09:40] [V] [TRT] Tactic: 9568255 Time: 0.0340206
[11/24/2022-12:09:40] [V] [TRT] Tactic: 10354687 Time: 0.0369371
[11/24/2022-12:09:40] [V] [TRT] Tactic: 10747903 Time: 0.0313307
[11/24/2022-12:09:40] [V] [TRT] Fastest Tactic: 10747903 Time: 0.0313307
[11/24/2022-12:09:40] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudnnConvolution)
[11/24/2022-12:09:40] [V] [TRT] Tactic: 0 Time: 0.048931
[11/24/2022-12:09:40] [V] [TRT] Tactic: 1 Time: 0.0537234
[11/24/2022-12:09:40] [V] [TRT] Tactic: 2 Time: 0.0989577
[11/24/2022-12:09:40] [V] [TRT] Tactic: 4 Time: 7.11349
[11/24/2022-12:09:40] [V] [TRT] Tactic: 5 Time: 0.178533
[11/24/2022-12:09:40] [V] [TRT] Tactic: 56 Time: 0.0447303
[11/24/2022-12:09:40] [V] [TRT] Tactic: 57 Time: 0.053565
[11/24/2022-12:09:40] [V] [TRT] Tactic: 58 Time: 0.0981989
[11/24/2022-12:09:40] [V] [TRT] Tactic: 60 Time: 7.12336
[11/24/2022-12:09:40] [V] [TRT] Tactic: 61 Time: 0.180078
[11/24/2022-12:09:40] [V] [TRT] Tactic: 112 Time: 0.0464571
[11/24/2022-12:09:40] [V] [TRT] Tactic: 113 Time: 0.0527695
[11/24/2022-12:09:40] [V] [TRT] Tactic: 114 Time: 0.099072
[11/24/2022-12:09:41] [V] [TRT] Tactic: 116 Time: 7.12848
[11/24/2022-12:09:41] [V] [TRT] Tactic: 117 Time: 0.179639
[11/24/2022-12:09:41] [V] [TRT] Fastest Tactic: 56 Time: 0.0447303
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:41] [V] [TRT] Tactic: 621442388677115936 Time: 0.0200697
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:41] [V] [TRT] Tactic: 697756878388249475 Time: 0.0184223
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0194749
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0207445
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0203217
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0345499
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0513844
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0208255
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0344357
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0285371
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0426469
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0399646
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0289673
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0290121
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0232261
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6723161876874263939 Time: 0.026848
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0178245
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0152055
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0314633
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:41] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0261867
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0396343
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0189034
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0290798
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7491730084094677098 Time: 0.039712
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0288174
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0506286
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0241539
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0399131
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0427429
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0291895
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0339621
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0364457
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0313682
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0154606
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0430834
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:41] [V] [TRT] Tactic: -701551393537224327 Time: 0.0365097
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3258434593395023 Time: 0.0823246
[11/24/2022-12:09:41] [V] [TRT] Fastest Tactic: 6901214267543238617 Time: 0.0152055
[11/24/2022-12:09:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6901214267543238617
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Float(177408,1,8064,192) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1162498931361159915 Time: 0.026029
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0402011
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0267947
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0262476
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4474630279712975759 Time: 0.019464
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0201989
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0286098
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0409177
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0179143
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0393874
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0178362
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0257166
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0423989
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0249623
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0181583
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0254621
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0398434
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0394777
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:41] [V] [TRT] Tactic: -504296718212024303 Time: 0.0392617
[11/24/2022-12:09:41] [V] [TRT] Fastest Tactic: -8031737312007363273 Time: 0.0178362
[11/24/2022-12:09:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8031737312007363273
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Float(44352,1:4,2016,48) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0176676
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2536540085349545921 Time: 0.017376
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0122712
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0103275
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0122648
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0154505
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0152786
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0221838
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0214713
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0124648
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:41] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0125714
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8853476220903838035 Time: 0.014373
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7067026478815706014 Time: 0.01786
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0116656
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0229956
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0123036
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0154615
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0223386
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1366318165940453381 Time: 0.014763
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0124278
[11/24/2022-12:09:41] [V] [TRT] Fastest Tactic: 5108195418077987197 Time: 0.0103275
[11/24/2022-12:09:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5108195418077987197
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Half(177408,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudnnConvolution)
[11/24/2022-12:09:41] [V] [TRT] Tactic: 0 Time: 0.0406846
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1 Time: 0.0577448
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2 Time: 0.109191
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4 Time: 7.11075
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5 Time: 0.136942
[11/24/2022-12:09:41] [V] [TRT] Tactic: 56 Time: 0.040896
[11/24/2022-12:09:41] [V] [TRT] Tactic: 58 Time: 0.109319
[11/24/2022-12:09:41] [V] [TRT] Tactic: 60 Time: 6.47119
[11/24/2022-12:09:41] [V] [TRT] Tactic: 61 Time: 0.133239
[11/24/2022-12:09:41] [V] [TRT] Fastest Tactic: 0 Time: 0.0406846
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Half(88704,924:2,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Half(88704,924:2,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (FusedConvActConvolution)
[11/24/2022-12:09:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Half(22176,1:8,1008,24) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] *************** Autotuning format combination: Half(22176,1:8,1008,24) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudaDepthwiseConvolution)
[11/24/2022-12:09:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:41] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:41] [V] [TRT] Tactic: 254850674756030979 Time: 0.0145609
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0157143
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0115249
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0138739
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0138631
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1576319725282257846 Time: 0.00967253
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1832046141070096030 Time: 0.00965272
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1838082074606840426 Time: 0.00964846
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0113048
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:41] [V] [TRT] Tactic: 1899296423087490472 Time: 0.009238
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2238656696610018305 Time: 0.00955947
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2541579301352125276 Time: 0.011673
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0138435
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2657157263811141609 Time: 0.00920571
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:41] [V] [TRT] Tactic: 2968605903460894194 Time: 0.00988312
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0088995
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3359475309458902373 Time: 0.00955489
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0116262
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0160477
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0137642
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:41] [V] [TRT] Tactic: 3899310434460415852 Time: 0.00764752
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4278315135102886928 Time: 0.00931286
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4370476717970497892 Time: 0.00939371
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4480294673430783793 Time: 0.00919229
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4491683531415781597 Time: 0.01375
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00998126
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0118006
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0158181
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0137696
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0123322
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:41] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00899714
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0140571
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0151205
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0114599
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0114894
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:41] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0136769
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6034364043891107501 Time: 0.00914886
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0152411
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0114993
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0110207
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6697277555581639516 Time: 0.00895143
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0115095
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:41] [V] [TRT] Tactic: 6859477213531075460 Time: 0.00897286
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:41] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0148325
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:41] [V] [TRT] Tactic: 7609923741161019135 Time: 0.00954331
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0115506
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8101703987960976805 Time: 0.00935114
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8170606396342855895 Time: 0.00980053
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0135605
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00891025
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:41] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0136952
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:41] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00777865
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:41] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0147474
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00946429
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0152302
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0149499
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:41] [V] [TRT] Tactic: -8131857373260504832 Time: 0.00957806
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00966491
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7099920365135295801 Time: 0.009486
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:41] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00913343
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0117901
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6356316196810535311 Time: 0.00987124
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:41] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0101352
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0122118
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00918114
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0125269
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0105071
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5127240325355316006 Time: 0.00973836
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:41] [V] [TRT] Tactic: -5109582882231362997 Time: 0.016032
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00927971
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0118945
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00970789
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00996053
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00931314
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0176152
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:41] [V] [TRT] Tactic: -4021926646879732549 Time: 0.00982552
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0119943
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0149248
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0124648
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0127501
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00948057
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0121512
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0152635
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:41] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0105228
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0118463
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0122179
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0126373
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0104859
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:41] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00962804
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0137164
[11/24/2022-12:09:41] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:41] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00943257
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1640527254204634147 Time: 0.00993219
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0119352
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1242202084391243207 Time: 0.00963505
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1099247066487349374 Time: 0.00931143
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1038291877007553549 Time: 0.00980785
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:42] [V] [TRT] Tactic: -406984317033388136 Time: 0.0147433
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:42] [V] [TRT] Tactic: -331499326992534460 Time: 0.00965425
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:42] [V] [TRT] Tactic: -206523504474952360 Time: 0.0120636
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.00764752
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Half(11088,1:16,504,12) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:42] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Half(5544,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CublasConvolution)
[11/24/2022-12:09:42] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(44352,924:4,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudaDepthwiseConvolution)
[11/24/2022-12:09:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0233273
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0234005
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0234789
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0176564
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0177656
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0179189
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0177961
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0176269
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:42] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0184411
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0178387
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:42] [V] [TRT] Tactic: -108011214168778087 Time: 0.0181486
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:42] [V] [TRT] Tactic: -42427192380281294 Time: 0.0176056
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: -42427192380281294 Time: 0.0176056
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -42427192380281294
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(44352,924:4,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudaDepthwiseConvolution)
[11/24/2022-12:09:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (FusedConvActConvolution)
[11/24/2022-12:09:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:42] [V] [TRT] Tactic: 175853789719975416 Time: 0.0165211
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0153038
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2234457234705232274 Time: 0.014917
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0150071
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0188286
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0149961
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0152983
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0148731
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0150437
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0200417
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0152055
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:42] [V] [TRT] Tactic: -683636008127039856 Time: 0.020348
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0148731
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(44352,924:4,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0153006
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0183983
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0149829
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0196137
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0148599
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0152219
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0150226
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4255737803793506479 Time: 0.019304
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0148997
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0152649
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0153527
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:42] [V] [TRT] Tactic: -868495160148524802 Time: 0.0150139
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0148599
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(5544,924:32,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3426497547019031858 Time: 0.00972922
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5104832031493112835 Time: 0.012205
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5287526117701381005 Time: 0.00966766
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: -5287526117701381005 Time: 0.00966766
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5287526117701381005
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(5544,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0124629
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00966248
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00940514
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0123352
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0152667
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6556170942941957134 Time: 0.012331
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6618077155362058131 Time: 0.00917514
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0123227
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7348718297764976805 Time: 0.00914143
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7869897696365535632 Time: 0.00921257
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7970271430402365872 Time: 0.009186
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00940229
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8912999970161746151 Time: 0.00917571
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0125147
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8069335661823714580 Time: 0.014645
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0123619
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0122575
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0152206
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00919886
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0125931
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0153335
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00932714
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6406011580107094428 Time: 0.00922057
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0126853
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0122846
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4704615512436071369 Time: 0.00971154
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0151397
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0125086
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3502495740607894730 Time: 0.009242
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:42] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0100645
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1610768292520086910 Time: 0.012736
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:42] [V] [TRT] Tactic: -621838502160440068 Time: 0.0126556
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: 7348718297764976805 Time: 0.00914143
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7348718297764976805
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(5544,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:42] [V] [TRT] Tactic: 424230345342282109 Time: 0.012739
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00964724
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0122823
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2881044142075831475 Time: 0.00752962
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0152247
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5730376045873629665 Time: 0.00746309
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0122495
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0122301
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00947457
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0151506
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00840766
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00753131
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00962804
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00798222
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00746811
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:42] [V] [TRT] Tactic: 9072692108481390634 Time: 0.00785516
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00924543
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00790304
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0074432
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0125436
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0123768
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0119973
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0119581
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5817829912551792981 Time: 0.012213
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00756475
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00877795
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0122469
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0121375
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:42] [V] [TRT] Tactic: -2649556861007671996 Time: 0.008608
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0152174
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0124781
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:42] [V] [TRT] Tactic: -50323486981480818 Time: 0.012259
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: -8206171403568243244 Time: 0.0074432
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8206171403568243244
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Int8(5544,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudaGroupConvolution)
[11/24/2022-12:09:42] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CudaDepthwiseConvolution)
[11/24/2022-12:09:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (FusedConvActConvolution)
[11/24/2022-12:09:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_568 + node_of_569 (CaskConvolution)
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:42] [V] [TRT] Tactic: 125145153013230687 Time: 0.0100922
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1583811548148740665 Time: 0.00907857
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1701344857577810806 Time: 0.00879435
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00831797
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0074976
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00773317
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00742857
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00779669
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00823086
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00755585
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00878709
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00725714
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00877418
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00946971
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5986622376339202983 Time: 0.00897114
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0100681
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6405251167055673379 Time: 0.008976
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0098112
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00773149
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6443933097134654777 Time: 0.00986911
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0080701
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00944057
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6925201228918187099 Time: 0.00973349
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6991524515605108718 Time: 0.00937571
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00907143
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0120541
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0119135
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0123158
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00876558
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8765382722978397630 Time: 0.00894943
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:42] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00808406
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:42] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00868894
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00916257
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00749189
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:42] [V] [TRT] Tactic: -6232597026469067819 Time: 0.00993585
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00894486
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5562968047117507056 Time: 0.00976091
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:42] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00741646
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00728594
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4425346730823666456 Time: 0.012312
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00895343
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:42] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0101955
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00754093
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00869808
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:42] [V] [TRT] Tactic: -3288585994448820820 Time: 0.00995627
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:42] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00914
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:42] [V] [TRT] Tactic: -2432868635536396215 Time: 0.00887126
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:42] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0122811
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1916483171117495388 Time: 0.00943771
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0102426
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1328736756812546664 Time: 0.00929886
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:42] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00756668
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:42] [V] [TRT] Tactic: -405554772060757402 Time: 0.00738309
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:42] [V] [TRT] Tactic: -375949437730908730 Time: 0.00842622
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:42] [V] [TRT] Tactic: -111878368089469751 Time: 0.012123
[11/24/2022-12:09:42] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:42] [V] [TRT] Tactic: -19707840769375107 Time: 0.00876908
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: 5204702486885981735 Time: 0.00725714
[11/24/2022-12:09:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5204702486885981735
[11/24/2022-12:09:42] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:42] [V] [TRT] *************** Autotuning format combination: Float(59136,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudaDepthwiseConvolution)
[11/24/2022-12:09:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (FusedConvActConvolution)
[11/24/2022-12:09:42] [V] [TRT] Tactic: 589823 Time: 0.127314
[11/24/2022-12:09:42] [V] [TRT] Tactic: 655359 Time: 0.114583
[11/24/2022-12:09:42] [V] [TRT] Tactic: 786431 Time: 0.109305
[11/24/2022-12:09:42] [V] [TRT] Tactic: 851967 Time: 0.105739
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1179647 Time: 0.107511
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1638399 Time: 0.108738
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2097151 Time: 0.105497
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3538943 Time: 0.104462
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3932159 Time: 0.108203
[11/24/2022-12:09:42] [V] [TRT] Tactic: 3997695 Time: 0.106763
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4194303 Time: 0.107454
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4259839 Time: 0.105913
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4587519 Time: 0.104766
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4653055 Time: 0.103525
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4915199 Time: 0.105054
[11/24/2022-12:09:42] [V] [TRT] Tactic: 4980735 Time: 0.109097
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5177343 Time: 0.108437
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5242879 Time: 0.104711
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5373951 Time: 0.109143
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5570559 Time: 0.104946
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5767167 Time: 0.137943
[11/24/2022-12:09:42] [V] [TRT] Tactic: 5898239 Time: 0.102382
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6225919 Time: 0.104832
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6291455 Time: 0.106798
[11/24/2022-12:09:42] [V] [TRT] Tactic: 6815743 Time: 0.11531
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7012351 Time: 0.105113
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7077887 Time: 0.105845
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7143423 Time: 0.129232
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7208959 Time: 0.108512
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7340031 Time: 0.110023
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7536639 Time: 0.125029
[11/24/2022-12:09:42] [V] [TRT] Tactic: 7733247 Time: 0.108231
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8191999 Time: 0.109664
[11/24/2022-12:09:42] [V] [TRT] Tactic: 8716287 Time: 0.115047
[11/24/2022-12:09:42] [V] [TRT] Tactic: 9109503 Time: 0.114
[11/24/2022-12:09:42] [V] [TRT] Tactic: 9568255 Time: 0.104789
[11/24/2022-12:09:42] [V] [TRT] Tactic: 10354687 Time: 0.113538
[11/24/2022-12:09:42] [V] [TRT] Tactic: 10747903 Time: 0.103202
[11/24/2022-12:09:42] [V] [TRT] Fastest Tactic: 5898239 Time: 0.102382
[11/24/2022-12:09:42] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudnnConvolution)
[11/24/2022-12:09:42] [V] [TRT] Tactic: 0 Time: 0.0743474
[11/24/2022-12:09:42] [V] [TRT] Tactic: 1 Time: 0.0721234
[11/24/2022-12:09:42] [V] [TRT] Tactic: 2 Time: 0.101111
[11/24/2022-12:09:43] [V] [TRT] Tactic: 4 Time: 25.3041
[11/24/2022-12:09:43] [V] [TRT] Tactic: 5 Time: 0.316768
[11/24/2022-12:09:43] [V] [TRT] Tactic: 56 Time: 0.0752069
[11/24/2022-12:09:43] [V] [TRT] Tactic: 57 Time: 0.0711192
[11/24/2022-12:09:43] [V] [TRT] Tactic: 58 Time: 0.0998651
[11/24/2022-12:09:43] [V] [TRT] Tactic: 60 Time: 21.6183
[11/24/2022-12:09:43] [V] [TRT] Tactic: 61 Time: 0.276667
[11/24/2022-12:09:43] [V] [TRT] Tactic: 112 Time: 0.0723383
[11/24/2022-12:09:43] [V] [TRT] Tactic: 113 Time: 0.0722149
[11/24/2022-12:09:43] [V] [TRT] Tactic: 114 Time: 0.0964457
[11/24/2022-12:09:43] [V] [TRT] Tactic: 116 Time: 19.1269
[11/24/2022-12:09:44] [V] [TRT] Tactic: 117 Time: 0.276347
[11/24/2022-12:09:44] [V] [TRT] Fastest Tactic: 57 Time: 0.0711192
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:44] [V] [TRT] Tactic: 621442388677115936 Time: 0.0355739
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:44] [V] [TRT] Tactic: 697756878388249475 Time: 0.0494964
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:44] [V] [TRT] Tactic: 1159272950022995759 Time: 0.031872
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:44] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0606552
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:44] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0354697
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:44] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0254651
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:44] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0422777
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0364137
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4549827808004681195 Time: 0.031061
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0539581
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0345079
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0287689
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0352073
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6210049212073459059 Time: 0.037728
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0366651
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0336832
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0290953
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0383897
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:44] [V] [TRT] Tactic: 8048119769507926928 Time: 0.040672
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:44] [V] [TRT] Tactic: 9151672657204310840 Time: 0.024621
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:44] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0272061
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:44] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0356891
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:44] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0437611
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:44] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0299255
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:44] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0421109
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:44] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0407109
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:44] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0234338
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:44] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0323877
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:44] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0342528
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:44] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0412674
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:44] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0279429
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:44] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0260008
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0451554
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0457097
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0346651
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:44] [V] [TRT] Tactic: -701551393537224327 Time: 0.0315931
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:44] [V] [TRT] Tactic: -3258434593395023 Time: 0.0400251
[11/24/2022-12:09:44] [V] [TRT] Fastest Tactic: -6622064180404051845 Time: 0.0234338
[11/24/2022-12:09:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6622064180404051845
[11/24/2022-12:09:44] [V] [TRT] *************** Autotuning format combination: Float(59136,1,2688,64) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:44] [V] [TRT] Tactic: 1162498931361159915 Time: 0.027853
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:44] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0317979
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:44] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0308809
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:44] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0285288
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0385326
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0382971
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0308864
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0318098
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0306459
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:44] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0316937
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:44] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0300105
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:44] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0289847
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:44] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0356169
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:44] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0277966
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:44] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0371257
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:44] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0280625
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:44] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0320283
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0317797
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:44] [V] [TRT] Tactic: -504296718212024303 Time: 0.0316663
[11/24/2022-12:09:44] [V] [TRT] Fastest Tactic: -4056705536979434560 Time: 0.0277966
[11/24/2022-12:09:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4056705536979434560
[11/24/2022-12:09:44] [V] [TRT] *************** Autotuning format combination: Float(14784,1:4,672,16) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:44] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0165511
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:44] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0211925
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:44] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0191017
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0236082
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0199966
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0195246
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6031243482516294286 Time: 0.01922
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0168757
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6571171993204510025 Time: 0.016866
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:44] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0192246
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:44] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0229153
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:44] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0341906
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:44] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0160041
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:44] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0261844
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:44] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0170479
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:44] [V] [TRT] Tactic: -5033173285090644307 Time: 0.019344
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:44] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0190154
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0169874
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0381726
[11/24/2022-12:09:44] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:44] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0207327
[11/24/2022-12:09:44] [V] [TRT] Fastest Tactic: -7067026478815706014 Time: 0.0160041
[11/24/2022-12:09:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7067026478815706014
[11/24/2022-12:09:44] [V] [TRT] *************** Autotuning format combination: Half(59136,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:44] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudnnConvolution)
[11/24/2022-12:09:44] [V] [TRT] Tactic: 0 Time: 0.0627429
[11/24/2022-12:09:44] [V] [TRT] Tactic: 1 Time: 0.0856594
[11/24/2022-12:09:44] [V] [TRT] Tactic: 2 Time: 0.0894857
[11/24/2022-12:09:44] [V] [TRT] Tactic: 4 Time: 19.1778
[11/24/2022-12:09:44] [V] [TRT] Tactic: 5 Time: 0.261518
[11/24/2022-12:09:44] [V] [TRT] Tactic: 56 Time: 0.0629288
[11/24/2022-12:09:44] [V] [TRT] Tactic: 58 Time: 0.0891566
[11/24/2022-12:09:44] [V] [TRT] Tactic: 60 Time: 19.1738
[11/24/2022-12:09:45] [V] [TRT] Tactic: 61 Time: 0.261449
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: 0 Time: 0.0627429
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (FusedConvActConvolution)
[11/24/2022-12:09:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0215308
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0266202
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0204127
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5548126322150286555 Time: 0.020336
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0205505
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0203971
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4884039206922900293 Time: 0.024173
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0208836
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0269341
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: 5548126322150286555 Time: 0.020336
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5548126322150286555
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudaDepthwiseConvolution)
[11/24/2022-12:09:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:45] [V] [TRT] Tactic: 254850674756030979 Time: 0.0118745
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1016009564074305832 Time: 0.012059
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0158597
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0117985
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0118157
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0184737
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0181543
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0160097
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1877373136269439559 Time: 0.013905
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0200943
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0156421
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0116564
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0115942
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0305701
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0161859
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0181457
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0143753
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0158162
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0129013
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0118393
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0136241
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0160757
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0137197
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0134699
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0114033
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4528997467275241200 Time: 0.011507
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0172764
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0120175
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0115439
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0172597
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0120236
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0118495
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0120701
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0114191
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0139828
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0180126
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0141585
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0118523
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0157006
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0203183
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0121524
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0142388
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0182011
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7216571380637776659 Time: 0.012701
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0158185
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0159319
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0203926
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0201886
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0176452
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0134882
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0119562
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:45] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0119486
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:45] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0176137
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8604374562669615024 Time: 0.027248
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0118062
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0115045
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0134458
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0288539
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0116913
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0246796
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0114215
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0313701
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0180531
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0114542
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0131109
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0160447
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0158877
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0143241
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0126442
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4950923835688973492 Time: 0.013696
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0202897
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0195611
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0157015
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4293222705763522367 Time: 0.017968
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0123078
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0169011
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0201086
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0182097
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0118625
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0120979
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3601464762214218301 Time: 0.018172
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0139516
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0116339
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0157467
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0114546
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0143922
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0160874
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0187023
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0139665
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0135015
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0178623
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0159258
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0114521
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0160091
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0264541
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0163581
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:45] [V] [TRT] Tactic: -406984317033388136 Time: 0.0116737
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:45] [V] [TRT] Tactic: -331499326992534460 Time: 0.0142678
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:45] [V] [TRT] Tactic: -206523504474952360 Time: 0.0137351
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: 4491683531415781597 Time: 0.0114033
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4491683531415781597
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Half(3696,1:16,168,4) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Half(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CublasConvolution)
[11/24/2022-12:09:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudaDepthwiseConvolution)
[11/24/2022-12:09:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0211899
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0209691
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0212924
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0180366
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0183714
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0175264
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0184634
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0175756
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0187143
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0189966
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:45] [V] [TRT] Tactic: -108011214168778087 Time: 0.0179377
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:45] [V] [TRT] Tactic: -42427192380281294 Time: 0.0176076
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0175264
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudaDepthwiseConvolution)
[11/24/2022-12:09:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (FusedConvActConvolution)
[11/24/2022-12:09:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:45] [V] [TRT] Tactic: 175853789719975416 Time: 0.0156315
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0157033
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0139969
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0144613
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0161031
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0143785
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0155342
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0139765
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0154752
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0159309
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0140808
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:45] [V] [TRT] Tactic: -683636008127039856 Time: 0.0160823
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0139765
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0149038
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0160853
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0141324
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0160452
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0139134
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6934773036503365000 Time: 0.013979
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0140671
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0160909
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0139798
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0155657
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0155685
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:45] [V] [TRT] Tactic: -868495160148524802 Time: 0.0139462
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0139134
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3426497547019031858 Time: 0.01976
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0227886
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0222929
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.01976
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2185926646498217601 Time: 0.019376
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0171891
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3721599319722771137 Time: 0.014555
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0156256
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5012796702462679112 Time: 0.016607
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0153842
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0146811
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6969462133921577484 Time: 0.02014
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0151771
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0153147
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0176538
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0180731
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0187926
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0196851
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0193429
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0153056
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7957004747664952265 Time: 0.01962
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0166664
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0172119
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0155118
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0167411
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0143232
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0163881
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0162265
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0153536
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0191006
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0195754
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0157627
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0150048
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0192223
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0158885
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:45] [V] [TRT] Tactic: -621838502160440068 Time: 0.0161686
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.0143232
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:45] [V] [TRT] Tactic: 424230345342282109 Time: 0.0116093
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00961432
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0114803
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0105228
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0116874
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0115604
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0112942
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0114964
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0099264
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0116318
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0111364
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00981669
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00976549
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0120739
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00989196
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:45] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0113843
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00947629
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0114412
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0100587
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0116965
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0116789
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6183300053070809929 Time: 0.00998796
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6079719874915919252 Time: 0.00995871
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0114613
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0117929
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0112753
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3556614738549917282 Time: 0.011532
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0108225
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0129097
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0114915
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0116607
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:45] [V] [TRT] Tactic: -50323486981480818 Time: 0.0115344
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: -8897233019398469012 Time: 0.00947629
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8897233019398469012
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudaGroupConvolution)
[11/24/2022-12:09:45] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CudaDepthwiseConvolution)
[11/24/2022-12:09:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (FusedConvActConvolution)
[11/24/2022-12:09:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_570 + node_of_571 + PWN(node_of_572) (CaskConvolution)
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:45] [V] [TRT] Tactic: 125145153013230687 Time: 0.00913
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1583811548148740665 Time: 0.00895886
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0113101
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0111441
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00962225
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0102495
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0103468
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:45] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0114535
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0119596
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0097277
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:45] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00898686
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00918772
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0108346
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00961829
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:45] [V] [TRT] Tactic: 5986622376339202983 Time: 0.00932743
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6007888770437705057 Time: 0.00898886
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00923229
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6433368103202497147 Time: 0.00965791
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6441948709525127755 Time: 0.011558
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0119219
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00977768
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00928343
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6925201228918187099 Time: 0.00971032
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:45] [V] [TRT] Tactic: 6991524515605108718 Time: 0.00977128
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:45] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00930771
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8142283985160822229 Time: 0.00940114
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8173975624668590862 Time: 0.00930829
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8234775147403903473 Time: 0.009484
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00888336
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:45] [V] [TRT] Tactic: 8765382722978397630 Time: 0.00908371
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:45] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0112953
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:45] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0101285
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00897514
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0116779
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:45] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0118811
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00924743
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5562968047117507056 Time: 0.008864
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:45] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00985478
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00985021
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4425346730823666456 Time: 0.00987855
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00927
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:45] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0131246
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0112847
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0124396
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:45] [V] [TRT] Tactic: -3288585994448820820 Time: 0.00886965
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0114725
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2432868635536396215 Time: 0.00891509
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:45] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0104849
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0100629
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0144096
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1328736756812546664 Time: 0.00992731
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0118242
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:45] [V] [TRT] Tactic: -405554772060757402 Time: 0.00989714
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:45] [V] [TRT] Tactic: -375949437730908730 Time: 0.0115861
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:45] [V] [TRT] Tactic: -111878368089469751 Time: 0.0118537
[11/24/2022-12:09:45] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:45] [V] [TRT] Tactic: -19707840769375107 Time: 0.0117851
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: -5562968047117507056 Time: 0.008864
[11/24/2022-12:09:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5562968047117507056
[11/24/2022-12:09:45] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:45] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudaDepthwiseConvolution)
[11/24/2022-12:09:45] [V] [TRT] Tactic: -1 Time: 0.0232842
[11/24/2022-12:09:45] [V] [TRT] Fastest Tactic: -1 Time: 0.0232842
[11/24/2022-12:09:45] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudnnConvolution)
[11/24/2022-12:09:45] [V] [TRT] Tactic: 0 Time: 0.0533044
[11/24/2022-12:09:45] [V] [TRT] Tactic: 1 Time: 0.053629
[11/24/2022-12:09:45] [V] [TRT] Tactic: 2 Time: 0.0698819
[11/24/2022-12:09:46] [V] [TRT] Tactic: 4 Time: 20.9282
[11/24/2022-12:09:46] [V] [TRT] Tactic: 5 Time: 18.7406
[11/24/2022-12:09:46] [V] [TRT] Tactic: 6 Time: 2.19507
[11/24/2022-12:09:46] [V] [TRT] Tactic: 56 Time: 0.0582979
[11/24/2022-12:09:46] [V] [TRT] Tactic: 57 Time: 0.0525562
[11/24/2022-12:09:46] [V] [TRT] Tactic: 58 Time: 0.0784411
[11/24/2022-12:09:46] [V] [TRT] Tactic: 60 Time: 20.8422
[11/24/2022-12:09:46] [V] [TRT] Tactic: 61 Time: 18.7332
[11/24/2022-12:09:46] [V] [TRT] Tactic: 62 Time: 2.19564
[11/24/2022-12:09:46] [V] [TRT] Tactic: 112 Time: 0.0532053
[11/24/2022-12:09:46] [V] [TRT] Tactic: 113 Time: 0.0535421
[11/24/2022-12:09:46] [V] [TRT] Tactic: 114 Time: 0.0896229
[11/24/2022-12:09:46] [V] [TRT] Tactic: 116 Time: 20.8255
[11/24/2022-12:09:46] [V] [TRT] Tactic: 117 Time: 18.8388
[11/24/2022-12:09:46] [V] [TRT] Tactic: 118 Time: 2.18798
[11/24/2022-12:09:46] [V] [TRT] Fastest Tactic: 57 Time: 0.0525562
[11/24/2022-12:09:46] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:46] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:09:46] [V] [TRT] Tactic: 130477820174479366 Time: 4.66972
[11/24/2022-12:09:46] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:09:47] [V] [TRT] Tactic: 1358952225285826925 Time: 5.20017
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:47] [V] [TRT] Tactic: 4549827808004681195 Time: 4.72191
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:09:47] [V] [TRT] Tactic: 5127140674766136213 Time: 3.45363
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:09:47] [V] [TRT] Tactic: 5691674214365884252 Time: 9.32653
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:47] [V] [TRT] Tactic: 5779835512569528575 Time: 5.24857
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:09:47] [V] [TRT] Tactic: 6053873026024413720 Time: 5.30698
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:09:47] [V] [TRT] Tactic: 6532229230713743445 Time: 4.6863
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:09:47] [V] [TRT] Tactic: 6767548733843469815 Time: 4.73045
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:09:47] [V] [TRT] Tactic: -7777264329408437990 Time: 4.07126
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:09:47] [V] [TRT] Tactic: -6693149634808211969 Time: 3.47382
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:47] [V] [TRT] Tactic: -6313876406580483184 Time: 4.44602
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:09:47] [V] [TRT] Tactic: -4932505327461806800 Time: 9.56003
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:09:47] [V] [TRT] Tactic: -2870780723387717246 Time: 3.66437
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:47] [V] [TRT] Tactic: -1123676555321336786 Time: 5.36805
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:47] [V] [TRT] Tactic: -701551393537224327 Time: 4.72532
[11/24/2022-12:09:47] [V] [TRT] Fastest Tactic: 5127140674766136213 Time: 3.45363
[11/24/2022-12:09:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:09:47] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:47] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:09:47] [V] [TRT] Tactic: 1852818056038333088 Time: 4.49662
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:09:47] [V] [TRT] Tactic: 2137271960938803767 Time: 6.3152
[11/24/2022-12:09:47] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:09:48] [V] [TRT] Tactic: 4543151729465212056 Time: 12.2686
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:09:48] [V] [TRT] Tactic: 5778138195697110002 Time: 2.57501
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:09:48] [V] [TRT] Tactic: 7098622778606028509 Time: 4.47327
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:09:48] [V] [TRT] Tactic: -9217704540809507511 Time: 10.5979
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:09:48] [V] [TRT] Tactic: -7734972403155710907 Time: 4.4712
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:09:48] [V] [TRT] Tactic: -3855385237722507463 Time: 2.60768
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:09:48] [V] [TRT] Tactic: -3360299822783115645 Time: 6.08893
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:09:48] [V] [TRT] Tactic: -2809379259463049392 Time: 2.58157
[11/24/2022-12:09:48] [V] [TRT] node_of_573 + node_of_574 + PWN(node_of_575) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:09:48] [V] [TRT] Tactic: -824800713406371346 Time: 6.19045
[11/24/2022-12:09:48] [V] [TRT] Fastest Tactic: 5778138195697110002 Time: 2.57501
[11/24/2022-12:09:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5778138195697110002
[11/24/2022-12:09:48] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:48] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:48] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:48] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudnnConvolution)
[11/24/2022-12:09:48] [V] [TRT] Tactic: 0 Time: 0.0478857
[11/24/2022-12:09:48] [V] [TRT] Tactic: 1 Time: 0.0488884
[11/24/2022-12:09:48] [V] [TRT] Tactic: 2 Time: 0.0699611
[11/24/2022-12:09:48] [V] [TRT] Tactic: 4 Time: 20.6967
[11/24/2022-12:09:48] [V] [TRT] Tactic: 5 Time: 18.6493
[11/24/2022-12:09:48] [V] [TRT] Tactic: 6 Time: 11.0103
[11/24/2022-12:09:48] [V] [TRT] Tactic: 56 Time: 0.0469851
[11/24/2022-12:09:48] [V] [TRT] Tactic: 58 Time: 0.0697448
[11/24/2022-12:09:49] [V] [TRT] Tactic: 60 Time: 20.8135
[11/24/2022-12:09:49] [V] [TRT] Tactic: 61 Time: 18.4767
[11/24/2022-12:09:49] [V] [TRT] Tactic: 62 Time: 10.9697
[11/24/2022-12:09:49] [V] [TRT] Fastest Tactic: 56 Time: 0.0469851
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudaDepthwiseConvolution)
[11/24/2022-12:09:49] [V] [TRT] Tactic: -2 Time: 0.0180497
[11/24/2022-12:09:49] [V] [TRT] Fastest Tactic: -2 Time: 0.0180497
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudaDepthwiseConvolution)
[11/24/2022-12:09:49] [V] [TRT] Tactic: -5 Time: 0.104133
[11/24/2022-12:09:49] [V] [TRT] Fastest Tactic: -5 Time: 0.104133
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudaDepthwiseConvolution)
[11/24/2022-12:09:49] [V] [TRT] Tactic: -3 Time: 0.0124206
[11/24/2022-12:09:49] [V] [TRT] Fastest Tactic: -3 Time: 0.0124206
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudaGroupConvolution)
[11/24/2022-12:09:49] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CudaDepthwiseConvolution)
[11/24/2022-12:09:49] [V] [TRT] Tactic: -4 Time: 0.0121589
[11/24/2022-12:09:49] [V] [TRT] Tactic: 0 Time: 0.0126545
[11/24/2022-12:09:49] [V] [TRT] Tactic: 1 Time: 0.012677
[11/24/2022-12:09:49] [V] [TRT] Tactic: 2 Time: 0.0126297
[11/24/2022-12:09:49] [V] [TRT] Tactic: 3 Time: 0.0126099
[11/24/2022-12:09:49] [V] [TRT] Tactic: 4 Time: 0.0180914
[11/24/2022-12:09:49] [V] [TRT] Tactic: 5 Time: 0.0153358
[11/24/2022-12:09:49] [V] [TRT] Tactic: 6 Time: 0.0220774
[11/24/2022-12:09:49] [V] [TRT] Tactic: 7 Time: 0.020529
[11/24/2022-12:09:49] [V] [TRT] Tactic: 8 Time: 0.0341147
[11/24/2022-12:09:49] [V] [TRT] Tactic: 9 Time: 0.0314121
[11/24/2022-12:09:49] [V] [TRT] Tactic: 10 Time: 0.0146802
[11/24/2022-12:09:49] [V] [TRT] Tactic: 11 Time: 0.0124202
[11/24/2022-12:09:49] [V] [TRT] Tactic: 12 Time: 0.015072
[11/24/2022-12:09:49] [V] [TRT] Tactic: 13 Time: 0.0125253
[11/24/2022-12:09:49] [V] [TRT] Tactic: 14 Time: 0.0180909
[11/24/2022-12:09:49] [V] [TRT] Tactic: 15 Time: 0.015285
[11/24/2022-12:09:49] [V] [TRT] Tactic: 16 Time: 0.0228382
[11/24/2022-12:09:49] [V] [TRT] Tactic: 17 Time: 0.0205133
[11/24/2022-12:09:49] [V] [TRT] Tactic: 18 Time: 0.0341541
[11/24/2022-12:09:49] [V] [TRT] Tactic: 19 Time: 0.0313819
[11/24/2022-12:09:49] [V] [TRT] Tactic: 20 Time: 0.013014
[11/24/2022-12:09:49] [V] [TRT] Tactic: 21 Time: 0.0148297
[11/24/2022-12:09:49] [V] [TRT] Tactic: 22 Time: 0.0150226
[11/24/2022-12:09:49] [V] [TRT] Tactic: 23 Time: 0.0147895
[11/24/2022-12:09:49] [V] [TRT] Tactic: 24 Time: 0.0180857
[11/24/2022-12:09:49] [V] [TRT] Tactic: 25 Time: 0.0154738
[11/24/2022-12:09:49] [V] [TRT] Tactic: 26 Time: 0.0209927
[11/24/2022-12:09:49] [V] [TRT] Tactic: 27 Time: 0.0205917
[11/24/2022-12:09:49] [V] [TRT] Tactic: 28 Time: 0.0342802
[11/24/2022-12:09:49] [V] [TRT] Tactic: 29 Time: 0.0313984
[11/24/2022-12:09:49] [V] [TRT] Tactic: 30 Time: 0.0124693
[11/24/2022-12:09:49] [V] [TRT] Tactic: 31 Time: 0.0126648
[11/24/2022-12:09:49] [V] [TRT] Tactic: 32 Time: 0.0125086
[11/24/2022-12:09:49] [V] [TRT] Tactic: 33 Time: 0.0123905
[11/24/2022-12:09:49] [V] [TRT] Tactic: 34 Time: 0.0177996
[11/24/2022-12:09:49] [V] [TRT] Tactic: 35 Time: 0.0150638
[11/24/2022-12:09:49] [V] [TRT] Tactic: 36 Time: 0.02077
[11/24/2022-12:09:49] [V] [TRT] Tactic: 37 Time: 0.0180594
[11/24/2022-12:09:49] [V] [TRT] Tactic: 38 Time: 0.033995
[11/24/2022-12:09:49] [V] [TRT] Tactic: 39 Time: 0.0286272
[11/24/2022-12:09:49] [V] [TRT] Tactic: 40 Time: 0.0125859
[11/24/2022-12:09:49] [V] [TRT] Tactic: 41 Time: 0.0121817
[11/24/2022-12:09:49] [V] [TRT] Tactic: 42 Time: 0.0148265
[11/24/2022-12:09:49] [V] [TRT] Tactic: 43 Time: 0.0123417
[11/24/2022-12:09:49] [V] [TRT] Tactic: 44 Time: 0.0179783
[11/24/2022-12:09:49] [V] [TRT] Tactic: 45 Time: 0.0150702
[11/24/2022-12:09:49] [V] [TRT] Tactic: 46 Time: 0.0209241
[11/24/2022-12:09:49] [V] [TRT] Tactic: 47 Time: 0.0179783
[11/24/2022-12:09:49] [V] [TRT] Tactic: 48 Time: 0.0340151
[11/24/2022-12:09:49] [V] [TRT] Tactic: 49 Time: 0.0284137
[11/24/2022-12:09:49] [V] [TRT] Tactic: 50 Time: 0.012688
[11/24/2022-12:09:49] [V] [TRT] Tactic: 51 Time: 0.0124118
[11/24/2022-12:09:49] [V] [TRT] Tactic: 52 Time: 0.0148233
[11/24/2022-12:09:49] [V] [TRT] Tactic: 53 Time: 0.0124838
[11/24/2022-12:09:49] [V] [TRT] Tactic: 54 Time: 0.0179223
[11/24/2022-12:09:49] [V] [TRT] Tactic: 55 Time: 0.01496
[11/24/2022-12:09:49] [V] [TRT] Tactic: 56 Time: 0.0207621
[11/24/2022-12:09:49] [V] [TRT] Tactic: 57 Time: 0.018032
[11/24/2022-12:09:49] [V] [TRT] Tactic: 58 Time: 0.0335671
[11/24/2022-12:09:49] [V] [TRT] Tactic: 59 Time: 0.0282933
[11/24/2022-12:09:49] [V] [TRT] Fastest Tactic: -4 Time: 0.0121589
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_573 + node_of_574 + PWN(node_of_575) (CaskConvolution)
[11/24/2022-12:09:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -4
[11/24/2022-12:09:49] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:49] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudaDepthwiseConvolution)
[11/24/2022-12:09:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (FusedConvActConvolution)
[11/24/2022-12:09:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:49] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudnnConvolution)
[11/24/2022-12:09:49] [V] [TRT] Tactic: 0 Time: 0.0558019
[11/24/2022-12:09:49] [V] [TRT] Tactic: 1 Time: 0.0947337
[11/24/2022-12:09:49] [V] [TRT] Tactic: 2 Time: 0.169888
[11/24/2022-12:09:49] [V] [TRT] Tactic: 4 Time: 25.1717
[11/24/2022-12:09:49] [V] [TRT] Tactic: 5 Time: 0.365353
[11/24/2022-12:09:49] [V] [TRT] Tactic: 56 Time: 0.0539931
[11/24/2022-12:09:49] [V] [TRT] Tactic: 57 Time: 0.0932091
[11/24/2022-12:09:49] [V] [TRT] Tactic: 58 Time: 0.166912
[11/24/2022-12:09:50] [V] [TRT] Tactic: 60 Time: 25.0025
[11/24/2022-12:09:50] [V] [TRT] Tactic: 61 Time: 0.316526
[11/24/2022-12:09:50] [V] [TRT] Tactic: 112 Time: 0.0522103
[11/24/2022-12:09:50] [V] [TRT] Tactic: 113 Time: 0.0560137
[11/24/2022-12:09:50] [V] [TRT] Tactic: 114 Time: 0.166825
[11/24/2022-12:09:50] [V] [TRT] Tactic: 116 Time: 19.1081
[11/24/2022-12:09:50] [V] [TRT] Tactic: 117 Time: 0.31365
[11/24/2022-12:09:50] [V] [TRT] Fastest Tactic: 112 Time: 0.0522103
[11/24/2022-12:09:50] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:50] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:50] [V] [TRT] Tactic: 621442388677115936 Time: 0.0244739
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:50] [V] [TRT] Tactic: 697756878388249475 Time: 0.0264221
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:50] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0264617
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:50] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0281745
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:50] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0307035
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:50] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0565699
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:50] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0908366
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:50] [V] [TRT] Tactic: 4032904638566464623 Time: 0.028035
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:50] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0563901
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:50] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0365234
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:50] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0714286
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:50] [V] [TRT] Tactic: 5837905844602864231 Time: 0.064128
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:50] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0495086
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:50] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0414869
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:50] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0309733
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:50] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0392731
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:50] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0232124
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:50] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0180709
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:50] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0497768
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:50] [V] [TRT] Tactic: 9151672657204310840 Time: 0.044344
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:50] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0624274
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:50] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0287589
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:50] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0474537
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:50] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0666606
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:50] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0446206
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:50] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0894651
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:50] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0448514
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:50] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0688808
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:50] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0713036
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:50] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0456971
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:50] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0538773
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:50] [V] [TRT] Tactic: -2777237991111865351 Time: 0.057984
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:50] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0478324
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:50] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0196086
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:50] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0728526
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:50] [V] [TRT] Tactic: -701551393537224327 Time: 0.0594545
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:50] [V] [TRT] Tactic: -3258434593395023 Time: 0.148375
[11/24/2022-12:09:50] [V] [TRT] Fastest Tactic: 6901214267543238617 Time: 0.0180709
[11/24/2022-12:09:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6901214267543238617
[11/24/2022-12:09:50] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384), Float(59136,1,2688,64) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:09:50] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:50] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:50] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0401589
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:50] [V] [TRT] Tactic: 1663866669559596164 Time: 0.070973
[11/24/2022-12:09:50] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0446766
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0408274
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0287049
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0286894
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4696204239951173149 Time: 0.045608
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0711299
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0266636
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:51] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0686766
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:51] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0266918
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:51] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0398857
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:51] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0748366
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:51] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0392469
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:51] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0269935
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:51] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0392309
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:51] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0704274
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:51] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0684587
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:51] [V] [TRT] Tactic: -504296718212024303 Time: 0.0667246
[11/24/2022-12:09:51] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0266636
[11/24/2022-12:09:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:09:51] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96), Float(14784,1:4,672,16) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0264876
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0224771
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0158949
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0133091
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0158309
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0225247
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0221747
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0328942
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0329243
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0159238
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:51] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0160147
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:51] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0179549
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:51] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0264198
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:51] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0134778
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:51] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0329408
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:51] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0159502
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:51] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0214217
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:51] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0329408
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:51] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0181143
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:51] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0160066
[11/24/2022-12:09:51] [V] [TRT] Fastest Tactic: 5108195418077987197 Time: 0.0133091
[11/24/2022-12:09:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5108195418077987197
[11/24/2022-12:09:51] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1), Half(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudnnConvolution)
[11/24/2022-12:09:51] [V] [TRT] Tactic: 0 Time: 0.0654278
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1 Time: 0.062627
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2 Time: 0.161435
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4 Time: 18.8497
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5 Time: 0.312699
[11/24/2022-12:09:51] [V] [TRT] Tactic: 56 Time: 0.0653912
[11/24/2022-12:09:51] [V] [TRT] Tactic: 58 Time: 0.161426
[11/24/2022-12:09:51] [V] [TRT] Tactic: 60 Time: 18.8386
[11/24/2022-12:09:51] [V] [TRT] Tactic: 61 Time: 0.312366
[11/24/2022-12:09:51] [V] [TRT] Fastest Tactic: 1 Time: 0.062627
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:09:51] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1), Half(29568,924:2,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (FusedConvActConvolution)
[11/24/2022-12:09:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:51] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48), Half(7392,1:8,336,8) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudaDepthwiseConvolution)
[11/24/2022-12:09:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:51] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:51] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:51] [V] [TRT] Tactic: 254850674756030979 Time: 0.020352
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0203914
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0141669
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1156328698016730421 Time: 0.020224
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0204029
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0118432
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1832046141070096030 Time: 0.011928
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0117145
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0139682
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:51] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0113575
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0116705
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0157234
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2559328254295148085 Time: 0.019712
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0111226
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:51] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0119196
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0110477
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0119261
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0150661
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0243139
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0201109
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:51] [V] [TRT] Tactic: 3899310434460415852 Time: 0.00917172
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011456
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4370476717970497892 Time: 0.011699
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0114145
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0193526
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0138157
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0158363
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0224947
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0191011
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0163561
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:51] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0113368
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0203623
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0204748
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0142092
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5346855796032465921 Time: 0.013846
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:51] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0179674
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0112886
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0202017
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0143287
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0132729
[11/24/2022-12:09:51] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:51] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0100379
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0139075
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0109571
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0223112
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7609923741161019135 Time: 0.011725
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0157038
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0114704
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0120255
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0179137
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00992091
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0202114
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:52] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00944514
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:52] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0181057
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0109394
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0205388
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0200189
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8131857373260504832 Time: 0.011148
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0105851
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7099920365135295801 Time: 0.011008
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00965181
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0138909
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0114458
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0118991
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0156562
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00977036
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0159619
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0116972
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0114106
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0212121
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00945914
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0119307
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0113502
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0116828
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00981059
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0224536
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0115917
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0119943
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0182109
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0160803
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0174217
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0106181
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0138872
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3200815656917281917 Time: 0.020495
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3058330359340425555 Time: 0.011764
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0140414
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0141282
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0162829
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0118062
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0113076
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0178869
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0100075
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0115995
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0137035
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0113435
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1099247066487349374 Time: 0.00978773
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0115608
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:52] [V] [TRT] Tactic: -406984317033388136 Time: 0.0187629
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:52] [V] [TRT] Tactic: -331499326992534460 Time: 0.0115189
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:52] [V] [TRT] Tactic: -206523504474952360 Time: 0.0135846
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.00917172
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24), Half(3696,1:16,168,4) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1), Half(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CublasConvolution)
[11/24/2022-12:09:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudaDepthwiseConvolution)
[11/24/2022-12:09:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:52] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0328869
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0329134
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0328485
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0236003
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0241958
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0253851
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5576936487443445631 Time: 0.024349
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0227951
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0267337
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0244084
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:52] [V] [TRT] Tactic: -108011214168778087 Time: 0.0264442
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:52] [V] [TRT] Tactic: -42427192380281294 Time: 0.0225796
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: -42427192380281294 Time: 0.0225796
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -42427192380281294
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Int8(14784,924:4,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudaDepthwiseConvolution)
[11/24/2022-12:09:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (FusedConvActConvolution)
[11/24/2022-12:09:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:52] [V] [TRT] Tactic: 175853789719975416 Time: 0.0247299
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0224163
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0215987
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0222949
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0304567
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6341572697076960911 Time: 0.020802
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0244884
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0203766
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0219337
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0306341
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3326139578711341011 Time: 0.02349
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:52] [V] [TRT] Tactic: -683636008127039856 Time: 0.0306277
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0203766
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Int8(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:52] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0242971
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0297115
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3606311198834416176 Time: 0.02237
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:52] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0306734
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0202937
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0229185
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4431642509665791294 Time: 0.020478
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0305655
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0209972
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0224372
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0246773
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:52] [V] [TRT] Tactic: -868495160148524802 Time: 0.0214955
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0202937
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0113217
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0122225
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0112383
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: -5287526117701381005 Time: 0.0112383
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5287526117701381005
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Float(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0122998
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00974354
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00913514
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:52] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0160249
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0221107
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0158327
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6618077155362058131 Time: 0.00937057
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0140023
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7348718297764976805 Time: 0.00898343
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7869897696365535632 Time: 0.00936686
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7970271430402365872 Time: 0.009394
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00953509
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8912999970161746151 Time: 0.00930457
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0136108
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0161366
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0158171
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0138942
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0209848
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00858756
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7606074703023778034 Time: 0.015906
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0216307
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00887019
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6406011580107094428 Time: 0.00895543
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0160483
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0158994
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0113354
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0160218
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0160356
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3502495740607894730 Time: 0.00904629
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0115671
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0162926
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:52] [V] [TRT] Tactic: -621838502160440068 Time: 0.0166044
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: -7633993163187901093 Time: 0.00858756
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7633993163187901093
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Half(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:52] [V] [TRT] Tactic: 424230345342282109 Time: 0.016033
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0114113
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0158304
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2881044142075831475 Time: 0.007968
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:52] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0209378
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5730376045873629665 Time: 0.00784217
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0146117
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0158761
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0116586
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0204245
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00912314
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00880403
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0113273
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00896886
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00909286
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:52] [V] [TRT] Tactic: 9072692108481390634 Time: 0.00771561
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0108415
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00781594
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00767519
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0159284
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6733478368603461850 Time: 0.016034
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0139084
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0138219
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0158121
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00839771
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00934914
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0157234
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0139287
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00891697
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0203674
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0157454
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:52] [V] [TRT] Tactic: -50323486981480818 Time: 0.0159543
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: -8206171403568243244 Time: 0.00767519
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8206171403568243244
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Int8(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudaGroupConvolution)
[11/24/2022-12:09:52] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CudaDepthwiseConvolution)
[11/24/2022-12:09:52] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (FusedConvActConvolution)
[11/24/2022-12:09:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:52] [V] [TRT] --------------- Timing Runner: node_of_576 + node_of_577 + node_of_578 (CaskConvolution)
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:52] [V] [TRT] Tactic: 125145153013230687 Time: 0.011879
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:52] [V] [TRT] Tactic: 1583811548148740665 Time: 0.00938543
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:52] [V] [TRT] Tactic: 1701344857577810806 Time: 0.00933371
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:52] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00906314
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:52] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00907114
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00966461
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00927457
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:52] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00920057
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:52] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00945343
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:52] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00933
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:52] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00979931
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00924057
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00975147
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0119733
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:52] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0100544
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0126964
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00996815
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0121718
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00914686
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0124899
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00966674
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0118017
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0119764
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:52] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0120571
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:52] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0100971
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0150857
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0149792
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8234775147403903473 Time: 0.015264
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00974476
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:52] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0100059
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:52] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00931457
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:52] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00932057
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00994072
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00938114
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:52] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0124678
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0097475
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0124156
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:52] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00931171
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00900371
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0179423
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00999528
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:52] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0125939
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00936486
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00956343
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:52] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0126034
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00999314
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2432868635536396215 Time: 0.00992031
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:52] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0152759
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0119093
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0128644
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0112535
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:52] [V] [TRT] Tactic: -1006589727652607355 Time: 0.009204
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:52] [V] [TRT] Tactic: -405554772060757402 Time: 0.00920886
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:52] [V] [TRT] Tactic: -375949437730908730 Time: 0.00974446
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:52] [V] [TRT] Tactic: -111878368089469751 Time: 0.0178771
[11/24/2022-12:09:52] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:52] [V] [TRT] Tactic: -19707840769375107 Time: 0.00980023
[11/24/2022-12:09:52] [V] [TRT] Fastest Tactic: -4455415102719506646 Time: 0.00900371
[11/24/2022-12:09:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4455415102719506646
[11/24/2022-12:09:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(59136,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(59136,1,2688,64) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(14784,1:4,672,16) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(59136,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(3696,1:16,168,4) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384), Float(59136,1,2688,64) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96), Float(14784,1:4,672,16) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1), Half(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1), Half(29568,924:2,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48), Half(7392,1:8,336,8) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24), Half(3696,1:16,168,4) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1), Half(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Int8(14784,924:4,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Int8(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Float(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Half(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Int8(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(59136,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(59136,1,2688,64) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(14784,1:4,672,16) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(59136,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(3696,1:16,168,4) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384), Float(59136,1,2688,64) -> Float(59136,1,2688,64) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96), Float(14784,1:4,672,16) -> Float(14784,1:4,672,16) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1), Half(59136,924,42,1) -> Half(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1), Half(29568,924:2,42,1) -> Half(29568,924:2,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48), Half(7392,1:8,336,8) -> Half(7392,1:8,336,8) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24), Half(3696,1:16,168,4) -> Half(3696,1:16,168,4) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1), Half(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Int8(14784,924:4,42,1) -> Int8(14784,924:4,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1), Int8(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Float(59136,924,42,1) -> Float(59136,924,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Float(1848,924:32,42,1) -> Float(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Half(1848,924:32,42,1) -> Half(1848,924:32,42,1) ***************
[11/24/2022-12:09:52] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1), Int8(1848,924:32,42,1) -> Int8(1848,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(59136,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(59136,1,2688,64) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(14784,1:4,672,16) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(59136,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(29568,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(7392,1:8,336,8) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(3696,1:16,168,4) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(14784,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(1848,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384) -> Float(354816,1,16128,384) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96) -> Float(88704,1:4,4032,96) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1) -> Half(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1) -> Half(177408,924:2,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Half(44352,1:8,2016,48) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24) -> Half(22176,1:16,1008,24) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(88704,924:4,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(354816,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Half(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Int8(11088,924:32,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:53] [V] [TRT] *************** Autotuning format combination: Float(354816,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:09:53] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudaDepthwiseConvolution)
[11/24/2022-12:09:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:53] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (FusedConvActConvolution)
[11/24/2022-12:09:53] [V] [TRT] Tactic: 589823 Time: 0.130992
[11/24/2022-12:09:53] [V] [TRT] Tactic: 655359 Time: 0.0997531
[11/24/2022-12:09:53] [V] [TRT] Tactic: 786431 Time: 0.0749326
[11/24/2022-12:09:53] [V] [TRT] Tactic: 851967 Time: 0.0697585
[11/24/2022-12:09:53] [V] [TRT] Tactic: 1179647 Time: 0.0721691
[11/24/2022-12:09:53] [V] [TRT] Tactic: 1638399 Time: 0.0737486
[11/24/2022-12:09:53] [V] [TRT] Tactic: 2097151 Time: 0.0650591
[11/24/2022-12:09:53] [V] [TRT] Tactic: 3538943 Time: 0.0715451
[11/24/2022-12:09:53] [V] [TRT] Tactic: 3932159 Time: 0.0843589
[11/24/2022-12:09:53] [V] [TRT] Tactic: 3997695 Time: 0.0697966
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4194303 Time: 0.0668663
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4259839 Time: 0.067491
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4587519 Time: 0.062877
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4653055 Time: 0.0685806
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4915199 Time: 0.0667596
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4980735 Time: 0.0701242
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5177343 Time: 0.0806606
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5242879 Time: 0.070589
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5373951 Time: 0.0932457
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5570559 Time: 0.0699078
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5767167 Time: 0.12835
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5898239 Time: 0.0709928
[11/24/2022-12:09:53] [V] [TRT] Tactic: 6225919 Time: 0.0719726
[11/24/2022-12:09:53] [V] [TRT] Tactic: 6291455 Time: 0.0740617
[11/24/2022-12:09:53] [V] [TRT] Tactic: 6815743 Time: 0.0830286
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7012351 Time: 0.0668023
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7077887 Time: 0.0739703
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7143423 Time: 0.106153
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7208959 Time: 0.0769006
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7340031 Time: 0.0798263
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7536639 Time: 0.133922
[11/24/2022-12:09:53] [V] [TRT] Tactic: 7733247 Time: 0.0824457
[11/24/2022-12:09:53] [V] [TRT] Tactic: 8191999 Time: 0.0922743
[11/24/2022-12:09:53] [V] [TRT] Tactic: 8716287 Time: 0.0876229
[11/24/2022-12:09:53] [V] [TRT] Tactic: 9109503 Time: 0.0822514
[11/24/2022-12:09:53] [V] [TRT] Tactic: 9568255 Time: 0.067104
[11/24/2022-12:09:53] [V] [TRT] Tactic: 10354687 Time: 0.0755703
[11/24/2022-12:09:53] [V] [TRT] Tactic: 10747903 Time: 0.0770263
[11/24/2022-12:09:53] [V] [TRT] Fastest Tactic: 4587519 Time: 0.062877
[11/24/2022-12:09:53] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudnnConvolution)
[11/24/2022-12:09:53] [V] [TRT] Tactic: 0 Time: 0.061821
[11/24/2022-12:09:53] [V] [TRT] Tactic: 1 Time: 0.0852366
[11/24/2022-12:09:53] [V] [TRT] Tactic: 2 Time: 0.151305
[11/24/2022-12:09:53] [V] [TRT] Tactic: 4 Time: 35.3298
[11/24/2022-12:09:53] [V] [TRT] Tactic: 5 Time: 0.436443
[11/24/2022-12:09:53] [V] [TRT] Tactic: 56 Time: 0.0589364
[11/24/2022-12:09:53] [V] [TRT] Tactic: 57 Time: 0.0873897
[11/24/2022-12:09:53] [V] [TRT] Tactic: 58 Time: 0.19013
[11/24/2022-12:09:54] [V] [TRT] Tactic: 60 Time: 28.1678
[11/24/2022-12:09:54] [V] [TRT] Tactic: 61 Time: 0.438885
[11/24/2022-12:09:54] [V] [TRT] Tactic: 112 Time: 0.0588526
[11/24/2022-12:09:54] [V] [TRT] Tactic: 113 Time: 0.060576
[11/24/2022-12:09:54] [V] [TRT] Tactic: 114 Time: 0.18805
[11/24/2022-12:09:54] [V] [TRT] Tactic: 116 Time: 28.1699
[11/24/2022-12:09:54] [V] [TRT] Tactic: 117 Time: 0.440425
[11/24/2022-12:09:54] [V] [TRT] Fastest Tactic: 112 Time: 0.0588526
[11/24/2022-12:09:54] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:55] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:55] [V] [TRT] Tactic: 621442388677115936 Time: 0.0228669
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:55] [V] [TRT] Tactic: 697756878388249475 Time: 0.0350153
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:55] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0245554
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:55] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0371657
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:55] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0475874
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:55] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0479817
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:55] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0828731
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0263459
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0558446
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0351269
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5779835512569528575 Time: 0.070723
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0562499
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0391886
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0401497
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0287333
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6723161876874263939 Time: 0.037712
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0205029
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0289618
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:55] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0399211
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:55] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0335131
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:55] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0543086
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:55] [V] [TRT] Tactic: -8766093103475083267 Time: 0.047616
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:55] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0455543
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:55] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0657158
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:55] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0434777
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:55] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0817211
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:55] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0329856
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:55] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0682606
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:55] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0703147
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:55] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0444606
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:55] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0535314
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:55] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0492831
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0464503
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0319945
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1123676555321336786 Time: 0.071261
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:55] [V] [TRT] Tactic: -701551393537224327 Time: 0.0579992
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:55] [V] [TRT] Tactic: -3258434593395023 Time: 0.141214
[11/24/2022-12:09:55] [V] [TRT] Fastest Tactic: 6868013466259746979 Time: 0.0205029
[11/24/2022-12:09:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6868013466259746979
[11/24/2022-12:09:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,16128,384) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:09:55] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:55] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:09:55] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0392571
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:09:55] [V] [TRT] Tactic: 1663866669559596164 Time: 0.070755
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:09:55] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0437851
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:09:55] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0391851
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0453691
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0455874
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0447726
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0704396
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0416194
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:09:55] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0674118
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:09:55] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0415051
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:09:55] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0391463
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:09:55] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0683718
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:09:55] [V] [TRT] Tactic: -4056705536979434560 Time: 0.038264
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:09:55] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0444423
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:09:55] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0390914
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:09:55] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0696792
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1985235291706575900 Time: 0.06736
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:09:55] [V] [TRT] Tactic: -504296718212024303 Time: 0.0665387
[11/24/2022-12:09:55] [V] [TRT] Fastest Tactic: -4056705536979434560 Time: 0.038264
[11/24/2022-12:09:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4056705536979434560
[11/24/2022-12:09:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,4032,96) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:09:55] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:55] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:09:55] [V] [TRT] Tactic: 1373022415249282411 Time: 0.024531
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:09:55] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0224392
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:09:55] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0157728
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0200903
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0157957
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0211233
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0202131
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0314395
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0306862
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:09:55] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0157289
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:09:55] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0160218
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:09:55] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0225345
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:09:55] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0244716
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:09:55] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0202926
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:09:55] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0322341
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:09:55] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0155575
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:09:55] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0201583
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1450865838092804082 Time: 0.030773
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0245288
[11/24/2022-12:09:55] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:09:55] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0159309
[11/24/2022-12:09:55] [V] [TRT] Fastest Tactic: -5033173285090644307 Time: 0.0155575
[11/24/2022-12:09:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5033173285090644307
[11/24/2022-12:09:55] [V] [TRT] *************** Autotuning format combination: Half(354816,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:09:55] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudnnConvolution)
[11/24/2022-12:09:55] [V] [TRT] Tactic: 0 Time: 0.0605013
[11/24/2022-12:09:55] [V] [TRT] Tactic: 1 Time: 0.0605166
[11/24/2022-12:09:55] [V] [TRT] Tactic: 2 Time: 0.158144
[11/24/2022-12:09:55] [V] [TRT] Tactic: 4 Time: 28.2007
[11/24/2022-12:09:55] [V] [TRT] Tactic: 5 Time: 0.428279
[11/24/2022-12:09:55] [V] [TRT] Tactic: 56 Time: 0.0604907
[11/24/2022-12:09:55] [V] [TRT] Tactic: 58 Time: 0.159131
[11/24/2022-12:09:56] [V] [TRT] Tactic: 60 Time: 28.1671
[11/24/2022-12:09:56] [V] [TRT] Tactic: 61 Time: 0.42768
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: 56 Time: 0.0604907
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Half(177408,924:2,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (FusedConvActConvolution)
[11/24/2022-12:09:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Float(88704,924,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,2016,48) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudaDepthwiseConvolution)
[11/24/2022-12:09:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:09:56] [V] [TRT] Tactic: 254850674756030979 Time: 0.0202029
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0202109
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0140517
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0199886
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1362727228442059924 Time: 0.020332
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1576319725282257846 Time: 0.011559
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0116638
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0118667
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0136324
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0137176
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0115991
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0140197
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0182069
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0158304
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0117802
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0156219
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0116526
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0139192
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0224366
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3704534001553878387 Time: 0.018212
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0114504
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4278315135102886928 Time: 0.011322
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0115724
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0111684
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0183029
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0134695
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0154802
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0223732
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0181629
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0159538
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0112971
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0202554
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5070322914990170527 Time: 0.020288
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0139175
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0135622
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0166166
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0112207
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6372404953297521067 Time: 0.020116
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0138772
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0117985
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6697277555581639516 Time: 0.00997333
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0137799
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0136744
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0204859
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0115376
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0139109
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0138273
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0116617
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0163982
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0112622
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0201349
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:09:56] [V] [TRT] Tactic: -9203179519031456182 Time: 0.011776
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:09:56] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0177702
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0158162
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0200846
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0185909
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8131857373260504832 Time: 0.011398
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0158796
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0104464
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0141511
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0135294
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0161935
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0114493
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0139832
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0118354
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0142575
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0116107
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0113586
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0204421
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4950923835688973492 Time: 0.011564
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0117728
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0138739
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0116856
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0137276
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0223706
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0113839
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0117732
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0181143
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0158085
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3864869056275745423 Time: 0.015933
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0136453
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3234716536615144018 Time: 0.013782
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0202737
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0116909
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0137932
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0138739
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0159695
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0115945
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0112577
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0166766
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0150318
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0116832
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0134683
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0111754
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1099247066487349374 Time: 0.015675
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0115021
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:09:56] [V] [TRT] Tactic: -406984317033388136 Time: 0.0182371
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:09:56] [V] [TRT] Tactic: -331499326992534460 Time: 0.0115365
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:09:56] [V] [TRT] Tactic: -206523504474952360 Time: 0.0137026
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: 6697277555581639516 Time: 0.00997333
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6697277555581639516
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Half(22176,1:16,1008,24) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Half(11088,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CublasConvolution)
[11/24/2022-12:09:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudaDepthwiseConvolution)
[11/24/2022-12:09:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0321509
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0310373
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0316279
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0223974
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0224216
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0245699
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0225796
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0223935
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0266484
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0243992
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:09:56] [V] [TRT] Tactic: -108011214168778087 Time: 0.0257943
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:09:56] [V] [TRT] Tactic: -42427192380281294 Time: 0.0224568
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: -4443833619060044580 Time: 0.0223935
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4443833619060044580
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudaDepthwiseConvolution)
[11/24/2022-12:09:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (FusedConvActConvolution)
[11/24/2022-12:09:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:09:56] [V] [TRT] Tactic: 175853789719975416 Time: 0.0245036
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0215066
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0202503
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0203274
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0288997
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0199349
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0225012
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0183937
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0202806
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0287168
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0224307
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:09:56] [V] [TRT] Tactic: -683636008127039856 Time: 0.0287543
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0183937
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(88704,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:09:56] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0223628
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0286254
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0202909
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0286501
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0183594
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0222433
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0189549
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0286747
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0201023
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0205244
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0241387
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:09:56] [V] [TRT] Tactic: -868495160148524802 Time: 0.0196966
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0183594
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0117647
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0119665
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0115415
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: -5287526117701381005 Time: 0.0115415
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5287526117701381005
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0132463
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00985112
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:09:56] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00947428
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0140663
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0203623
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0148795
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0113255
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:09:56] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0143049
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0112243
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0112102
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7970271430402365872 Time: 0.00955977
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00979139
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8912999970161746151 Time: 0.00924057
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0133989
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0178994
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0139595
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0138801
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0205264
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00988648
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0142188
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0203006
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00923914
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6406011580107094428 Time: 0.010351
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0156658
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0140563
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:09:56] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0113653
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0180977
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0153321
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0111986
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0115393
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0157623
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:09:56] [V] [TRT] Tactic: -621838502160440068 Time: 0.0157966
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.00923914
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:09:56] [V] [TRT] Tactic: 424230345342282109 Time: 0.0158441
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00945086
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2327398338581585326 Time: 0.015056
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:09:56] [V] [TRT] Tactic: 2881044142075831475 Time: 0.00918571
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:09:56] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0204376
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:09:56] [V] [TRT] Tactic: 5730376045873629665 Time: 0.00991177
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7107586691882206281 Time: 0.013888
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0140509
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00977493
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0203314
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00846629
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:09:56] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00816381
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00966034
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00980724
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:09:56] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00818743
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:09:56] [V] [TRT] Tactic: 9072692108481390634 Time: 0.00972983
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00921429
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00941143
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:09:56] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00900429
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:09:56] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0156699
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0153632
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0134562
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:09:56] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0134072
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0140551
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:09:56] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00946686
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00898457
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0140401
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:09:56] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0137666
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:09:56] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00985813
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0202634
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:09:56] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0139616
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:09:56] [V] [TRT] Tactic: -50323486981480818 Time: 0.0143744
[11/24/2022-12:09:56] [V] [TRT] Fastest Tactic: 7796695344726998947 Time: 0.00816381
[11/24/2022-12:09:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7796695344726998947
[11/24/2022-12:09:56] [V] [TRT] *************** Autotuning format combination: Int8(11088,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudaGroupConvolution)
[11/24/2022-12:09:56] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CudaDepthwiseConvolution)
[11/24/2022-12:09:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (FusedConvActConvolution)
[11/24/2022-12:09:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:56] [V] [TRT] --------------- Timing Runner: node_of_603 + node_of_604 (CaskConvolution)
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:09:56] [V] [TRT] Tactic: 125145153013230687 Time: 0.0115977
[11/24/2022-12:09:56] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:09:57] [V] [TRT] Tactic: 1583811548148740665 Time: 0.00911343
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:09:57] [V] [TRT] Tactic: 1701344857577810806 Time: 0.00886131
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:09:57] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00896943
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:09:57] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00810692
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:09:57] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00910314
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:09:57] [V] [TRT] Tactic: 3538565962642681625 Time: 0.009146
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:09:57] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00977067
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0097475
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00807746
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00900429
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00903086
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00885324
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00943257
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5986622376339202983 Time: 0.00920257
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0116251
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00908229
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0098691
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00974263
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0114409
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00883308
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00952533
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6925201228918187099 Time: 0.00949971
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6991524515605108718 Time: 0.00981973
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00921971
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8142283985160822229 Time: 0.013654
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0134038
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0135688
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00890245
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8765382722978397630 Time: 0.00911143
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:09:57] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00777191
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:09:57] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00911086
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:09:57] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00890434
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:09:57] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00947629
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:09:57] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0113681
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:09:57] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00891644
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:09:57] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0113582
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:09:57] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00785781
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:09:57] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00904257
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:09:57] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0138385
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:09:57] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00900914
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:09:57] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0115007
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:09:57] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00933514
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:09:57] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00979291
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:09:57] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0114437
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:09:57] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00911143
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:09:57] [V] [TRT] Tactic: -2432868635536396215 Time: 0.009054
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:09:57] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0137567
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:09:57] [V] [TRT] Tactic: -1916483171117495388 Time: 0.00959726
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:09:57] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0115531
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:09:57] [V] [TRT] Tactic: -1328736756812546664 Time: 0.00948972
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:09:57] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00873842
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:09:57] [V] [TRT] Tactic: -405554772060757402 Time: 0.00936457
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:09:57] [V] [TRT] Tactic: -375949437730908730 Time: 0.00888255
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:09:57] [V] [TRT] Tactic: -111878368089469751 Time: 0.0140871
[11/24/2022-12:09:57] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:09:57] [V] [TRT] Tactic: -19707840769375107 Time: 0.00894429
[11/24/2022-12:09:57] [V] [TRT] Fastest Tactic: -8638624340850784688 Time: 0.00777191
[11/24/2022-12:09:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8638624340850784688
[11/24/2022-12:09:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:09:57] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:09:57] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudaDepthwiseConvolution)
[11/24/2022-12:09:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:57] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (FusedConvActConvolution)
[11/24/2022-12:09:57] [V] [TRT] Tactic: 589823 Time: 0.22453
[11/24/2022-12:09:57] [V] [TRT] Tactic: 655359 Time: 0.152366
[11/24/2022-12:09:57] [V] [TRT] Tactic: 786431 Time: 0.155246
[11/24/2022-12:09:57] [V] [TRT] Tactic: 851967 Time: 0.150185
[11/24/2022-12:09:57] [V] [TRT] Tactic: 1179647 Time: 0.149079
[11/24/2022-12:09:57] [V] [TRT] Tactic: 1638399 Time: 0.163182
[11/24/2022-12:09:57] [V] [TRT] Tactic: 2097151 Time: 0.148859
[11/24/2022-12:09:57] [V] [TRT] Tactic: 3538943 Time: 0.146866
[11/24/2022-12:09:57] [V] [TRT] Tactic: 3932159 Time: 0.154528
[11/24/2022-12:09:57] [V] [TRT] Tactic: 3997695 Time: 0.151099
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4194303 Time: 0.14603
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4259839 Time: 0.154976
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4587519 Time: 0.140039
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4653055 Time: 0.148032
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4915199 Time: 0.148393
[11/24/2022-12:09:57] [V] [TRT] Tactic: 4980735 Time: 0.158359
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5177343 Time: 0.159095
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5242879 Time: 0.16144
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5373951 Time: 0.169755
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5570559 Time: 0.141982
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5767167 Time: 0.23653
[11/24/2022-12:09:57] [V] [TRT] Tactic: 5898239 Time: 0.149737
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6225919 Time: 0.146217
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6291455 Time: 0.152251
[11/24/2022-12:09:57] [V] [TRT] Tactic: 6815743 Time: 0.167182
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7012351 Time: 0.156091
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7077887 Time: 0.150743
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7143423 Time: 0.196558
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7208959 Time: 0.157403
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7340031 Time: 0.163877
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7536639 Time: 0.189536
[11/24/2022-12:09:57] [V] [TRT] Tactic: 7733247 Time: 0.158469
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8191999 Time: 0.173783
[11/24/2022-12:09:57] [V] [TRT] Tactic: 8716287 Time: 0.178025
[11/24/2022-12:09:57] [V] [TRT] Tactic: 9109503 Time: 0.18219
[11/24/2022-12:09:57] [V] [TRT] Tactic: 9568255 Time: 0.151694
[11/24/2022-12:09:57] [V] [TRT] Tactic: 10354687 Time: 0.173687
[11/24/2022-12:09:57] [V] [TRT] Tactic: 10747903 Time: 0.142999
[11/24/2022-12:09:57] [V] [TRT] Fastest Tactic: 4587519 Time: 0.140039
[11/24/2022-12:09:57] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudnnConvolution)
[11/24/2022-12:09:57] [V] [TRT] Tactic: 0 Time: 0.111986
[11/24/2022-12:09:57] [V] [TRT] Tactic: 1 Time: 0.0667642
[11/24/2022-12:09:57] [V] [TRT] Tactic: 2 Time: 0.14667
[11/24/2022-12:09:58] [V] [TRT] Tactic: 4 Time: 43.7793
[11/24/2022-12:09:58] [V] [TRT] Tactic: 5 Time: 0.532622
[11/24/2022-12:09:58] [V] [TRT] Tactic: 56 Time: 0.112501
[11/24/2022-12:09:58] [V] [TRT] Tactic: 57 Time: 0.0721143
[11/24/2022-12:09:58] [V] [TRT] Tactic: 58 Time: 0.166149
[11/24/2022-12:09:58] [V] [TRT] Tactic: 60 Time: 42.8043
[11/24/2022-12:09:59] [V] [TRT] Tactic: 61 Time: 0.53493
[11/24/2022-12:09:59] [V] [TRT] Tactic: 112 Time: 0.112514
[11/24/2022-12:09:59] [V] [TRT] Tactic: 113 Time: 0.0965029
[11/24/2022-12:09:59] [V] [TRT] Tactic: 114 Time: 0.148421
[11/24/2022-12:09:59] [V] [TRT] Tactic: 116 Time: 42.8008
[11/24/2022-12:09:59] [V] [TRT] Tactic: 117 Time: 0.535355
[11/24/2022-12:09:59] [V] [TRT] Fastest Tactic: 1 Time: 0.0667642
[11/24/2022-12:09:59] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:09:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:59] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:09:59] [V] [TRT] Tactic: 621442388677115936 Time: 0.0608091
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:09:59] [V] [TRT] Tactic: 697756878388249475 Time: 0.0901143
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:09:59] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0566827
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:09:59] [V] [TRT] Tactic: 1327459216264546184 Time: 0.107033
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:09:59] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0640031
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:09:59] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0491291
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:09:59] [V] [TRT] Tactic: 3377996665278764661 Time: 0.100999
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:09:59] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0645882
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:09:59] [V] [TRT] Tactic: 4549827808004681195 Time: 0.059901
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:09:59] [V] [TRT] Tactic: 4918658762935651592 Time: 0.102245
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:09:59] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0627291
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:09:59] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0639299
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:09:59] [V] [TRT] Tactic: 6166883504066133838 Time: 0.057501
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:09:59] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0595276
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:09:59] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0731063
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:09:59] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0531749
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:09:59] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0503756
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:09:59] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0669867
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:09:59] [V] [TRT] Tactic: 8048119769507926928 Time: 0.06736
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:09:59] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0467737
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:09:59] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0542126
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:09:59] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0640381
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:09:59] [V] [TRT] Tactic: -8198656951359619379 Time: 0.069501
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:09:59] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0610301
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:09:59] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0710644
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:09:59] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0943497
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:09:59] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0393989
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:09:59] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0644084
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:09:59] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0622293
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:09:59] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0702034
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:09:59] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0552869
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:09:59] [V] [TRT] Tactic: -2777237991111865351 Time: 0.050048
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:09:59] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0789166
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:09:59] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0789531
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:09:59] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0630339
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:09:59] [V] [TRT] Tactic: -701551393537224327 Time: 0.0602209
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:09:59] [V] [TRT] Tactic: -3258434593395023 Time: 0.0926423
[11/24/2022-12:09:59] [V] [TRT] Fastest Tactic: -6622064180404051845 Time: 0.0393989
[11/24/2022-12:09:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6622064180404051845
[11/24/2022-12:09:59] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:09:59] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:09:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:09:59] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:09:59] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:00] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0546408
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:00] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0585234
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:00] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0578621
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:00] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0544777
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:00] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0656549
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:00] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0648579
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:00] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0589531
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:00] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0587703
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:00] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0526918
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:00] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0574766
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:00] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0525013
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:00] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0550644
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:00] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0667002
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:00] [V] [TRT] Tactic: -4056705536979434560 Time: 0.053341
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:00] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0637074
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:00] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0536838
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:00] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0596556
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:00] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0567939
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:00] [V] [TRT] Tactic: -504296718212024303 Time: 0.0574202
[11/24/2022-12:10:00] [V] [TRT] Fastest Tactic: -8031737312007363273 Time: 0.0525013
[11/24/2022-12:10:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8031737312007363273
[11/24/2022-12:10:00] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:10:00] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:00] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:00] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0264716
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:00] [V] [TRT] Tactic: 2536540085349545921 Time: 0.031968
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:00] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0303323
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:00] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0409874
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:00] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0352183
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:00] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0296549
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:00] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0296503
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:00] [V] [TRT] Tactic: 6419443404913215692 Time: 0.029621
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:00] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0307328
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:00] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0325906
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:00] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0391189
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:00] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0585478
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:00] [V] [TRT] Tactic: -7067026478815706014 Time: 0.026275
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:00] [V] [TRT] Tactic: -6407735577805887428 Time: 0.044272
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:00] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0308206
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:00] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0317266
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:00] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0288485
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:00] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0305481
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:00] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0641844
[11/24/2022-12:10:00] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:00] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0338213
[11/24/2022-12:10:00] [V] [TRT] Fastest Tactic: -7067026478815706014 Time: 0.026275
[11/24/2022-12:10:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7067026478815706014
[11/24/2022-12:10:00] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:00] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudnnConvolution)
[11/24/2022-12:10:00] [V] [TRT] Tactic: 0 Time: 0.101913
[11/24/2022-12:10:00] [V] [TRT] Tactic: 1 Time: 0.102117
[11/24/2022-12:10:00] [V] [TRT] Tactic: 2 Time: 0.140162
[11/24/2022-12:10:00] [V] [TRT] Tactic: 4 Time: 42.8134
[11/24/2022-12:10:00] [V] [TRT] Tactic: 5 Time: 0.514619
[11/24/2022-12:10:00] [V] [TRT] Tactic: 56 Time: 0.101803
[11/24/2022-12:10:00] [V] [TRT] Tactic: 58 Time: 0.139527
[11/24/2022-12:10:01] [V] [TRT] Tactic: 60 Time: 42.8255
[11/24/2022-12:10:01] [V] [TRT] Tactic: 61 Time: 0.513161
[11/24/2022-12:10:01] [V] [TRT] Fastest Tactic: 56 Time: 0.101803
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:10:01] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (FusedConvActConvolution)
[11/24/2022-12:10:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudaDepthwiseConvolution)
[11/24/2022-12:10:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:01] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:01] [V] [TRT] Tactic: 254850674756030979 Time: 0.0226449
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0236558
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0243901
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0245691
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0211579
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0313353
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0306249
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0238126
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0223445
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:01] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0326345
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:01] [V] [TRT] Tactic: 2238656696610018305 Time: 0.02275
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:01] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0198731
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:01] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0190491
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:01] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0455303
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:01] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0245158
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:01] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0294747
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:01] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0209385
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:01] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0244922
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:01] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0248091
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:01] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0244038
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:01] [V] [TRT] Tactic: 3899310434460415852 Time: 0.020497
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0267589
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0200394
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0178245
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4491683531415781597 Time: 0.018248
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0159924
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0266857
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0245737
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0186011
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0268861
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:01] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0166481
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:01] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0224242
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:01] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0227344
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:01] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0185177
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:01] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0224189
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:01] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0285516
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0231876
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0226998
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0238339
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0333632
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0162616
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0225887
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:01] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0310583
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:01] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0217071
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:01] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0231915
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:01] [V] [TRT] Tactic: 8095507026323593899 Time: 0.024605
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:01] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0330139
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:01] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0325458
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:01] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0285844
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:01] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0183223
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:01] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207484
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:01] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0182806
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:01] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0286062
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:01] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0416046
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:01] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0226697
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:01] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0185183
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:01] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0202686
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:01] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0435349
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:01] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0162631
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:01] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0373897
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:01] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0161575
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:01] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0476328
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:01] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0290523
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:01] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0197269
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:01] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0192389
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:01] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0259025
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:01] [V] [TRT] Tactic: -5161596964442251102 Time: 0.023409
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:01] [V] [TRT] Tactic: -5127240325355316006 Time: 0.02368
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:01] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0244914
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:01] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0223412
[11/24/2022-12:10:01] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0315538
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0312009
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0228016
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0298359
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0244686
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0276259
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0327717
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0288987
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0207327
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0205832
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0308937
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0227115
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0225587
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0232281
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0166745
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0227344
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0267642
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2032577876140256150 Time: 0.031189
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0227729
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0224607
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0286208
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1640527254204634147 Time: 0.022912
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0162723
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0268983
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0394011
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0275573
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:02] [V] [TRT] Tactic: -406984317033388136 Time: 0.0229401
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:02] [V] [TRT] Tactic: -331499326992534460 Time: 0.0225254
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:02] [V] [TRT] Tactic: -206523504474952360 Time: 0.0218965
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: 4528997467275241200 Time: 0.0159924
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4528997467275241200
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CublasConvolution)
[11/24/2022-12:10:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudaDepthwiseConvolution)
[11/24/2022-12:10:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:02] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0332626
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0330999
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0339776
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0313445
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0286373
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6580271968881459581 Time: 0.029589
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0290752
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0309486
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0309888
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0323145
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:02] [V] [TRT] Tactic: -108011214168778087 Time: 0.0300325
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:02] [V] [TRT] Tactic: -42427192380281294 Time: 0.028109
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: -42427192380281294 Time: 0.028109
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -42427192380281294
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudaDepthwiseConvolution)
[11/24/2022-12:10:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (FusedConvActConvolution)
[11/24/2022-12:10:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:02] [V] [TRT] Tactic: 175853789719975416 Time: 0.0246034
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0264922
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0224274
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0228127
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0254202
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0245036
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0243375
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0223419
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7303593854972602201 Time: 0.024528
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6585664687867083638 Time: 0.026445
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0226247
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:02] [V] [TRT] Tactic: -683636008127039856 Time: 0.0264168
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0223419
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:02] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0244091
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2855900226702061782 Time: 0.025277
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0224633
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0263368
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0224235
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0226031
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4431642509665791294 Time: 0.024445
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0264952
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0244648
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0260815
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0245181
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:02] [V] [TRT] Tactic: -868495160148524802 Time: 0.0223236
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: -868495160148524802 Time: 0.0223236
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -868495160148524802
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3426497547019031858 Time: 0.027731
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0318693
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0315959
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.027731
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(16632,924:32,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0271619
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0232522
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0238498
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0199394
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0240617
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0238322
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0217783
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0273882
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0206315
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0220656
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0229466
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0257836
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0240587
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0292041
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0270514
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0244358
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7957004747664952265 Time: 0.027309
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0232398
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0232085
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0207536
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0239406
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0203926
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0226664
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0213682
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0245646
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0254278
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0278629
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0208078
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0212369
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0262667
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1610768292520086910 Time: 0.021905
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:02] [V] [TRT] Tactic: -621838502160440068 Time: 0.0219102
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: 4178917718361232468 Time: 0.0199394
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4178917718361232468
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:02] [V] [TRT] Tactic: 424230345342282109 Time: 0.0204702
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0138527
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0186314
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0150962
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0224823
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0176274
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0163185
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0186503
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0157915
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0224235
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0148256
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0138431
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8142426754608472547 Time: 0.014171
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0183006
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0138739
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:02] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0162235
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0139927
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0160432
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0141477
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0203343
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0198034
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0158606
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0160513
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0183223
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0179154
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0156905
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0184829
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0172968
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2649556861007671996 Time: 0.01916
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0221597
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0192571
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:02] [V] [TRT] Tactic: -50323486981480818 Time: 0.0187217
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: 7796695344726998947 Time: 0.0138431
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7796695344726998947
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudaGroupConvolution)
[11/24/2022-12:10:02] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CudaDepthwiseConvolution)
[11/24/2022-12:10:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (FusedConvActConvolution)
[11/24/2022-12:10:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_605 + node_of_606 + PWN(node_of_607) (CaskConvolution)
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:02] [V] [TRT] Tactic: 125145153013230687 Time: 0.0138668
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:02] [V] [TRT] Tactic: 1583811548148740665 Time: 0.011915
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:02] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0138572
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:02] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0157253
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0137592
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0149655
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3538565962642681625 Time: 0.014395
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:02] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0159365
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0183629
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0136806
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0119318
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0120602
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0134516
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0137035
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:02] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0136495
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6007888770437705057 Time: 0.013969
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0132962
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0140185
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0174547
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0137696
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0138502
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0136769
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0139591
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:02] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0114356
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:02] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0137525
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0158231
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0157815
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0161128
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0133556
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:02] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0138398
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:02] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0139541
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:02] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0155433
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0119798
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0178017
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:02] [V] [TRT] Tactic: -6232597026469067819 Time: 0.013935
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0137529
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0137542
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:02] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0138157
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0138568
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0142512
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0140039
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:02] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0139678
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0159675
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0186926
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:02] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0137629
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0159863
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0119703
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:02] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0160163
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1916483171117495388 Time: 0.011296
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0140102
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0138872
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1006589727652607355 Time: 0.013969
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:02] [V] [TRT] Tactic: -405554772060757402 Time: 0.0133885
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:02] [V] [TRT] Tactic: -375949437730908730 Time: 0.0140567
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:02] [V] [TRT] Tactic: -111878368089469751 Time: 0.0142259
[11/24/2022-12:10:02] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:02] [V] [TRT] Tactic: -19707840769375107 Time: 0.0141286
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: -1916483171117495388 Time: 0.011296
[11/24/2022-12:10:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1916483171117495388
[11/24/2022-12:10:02] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:02] [V] [TRT] *************** Autotuning format combination: Float(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudaDepthwiseConvolution)
[11/24/2022-12:10:02] [V] [TRT] Tactic: -1 Time: 0.0393806
[11/24/2022-12:10:02] [V] [TRT] Fastest Tactic: -1 Time: 0.0393806
[11/24/2022-12:10:02] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudnnConvolution)
[11/24/2022-12:10:02] [V] [TRT] Tactic: 0 Time: 0.0762194
[11/24/2022-12:10:02] [V] [TRT] Tactic: 1 Time: 0.0739154
[11/24/2022-12:10:02] [V] [TRT] Tactic: 2 Time: 0.114526
[11/24/2022-12:10:02] [V] [TRT] Tactic: 4 Time: 27.316
[11/24/2022-12:10:03] [V] [TRT] Tactic: 5 Time: 26.5128
[11/24/2022-12:10:03] [V] [TRT] Tactic: 6 Time: 3.0948
[11/24/2022-12:10:03] [V] [TRT] Tactic: 56 Time: 0.0747063
[11/24/2022-12:10:03] [V] [TRT] Tactic: 57 Time: 0.0804571
[11/24/2022-12:10:03] [V] [TRT] Tactic: 58 Time: 0.116014
[11/24/2022-12:10:03] [V] [TRT] Tactic: 60 Time: 30.7984
[11/24/2022-12:10:03] [V] [TRT] Tactic: 61 Time: 28.2543
[11/24/2022-12:10:03] [V] [TRT] Tactic: 62 Time: 3.24236
[11/24/2022-12:10:03] [V] [TRT] Tactic: 112 Time: 0.0865234
[11/24/2022-12:10:03] [V] [TRT] Tactic: 113 Time: 0.0920023
[11/24/2022-12:10:03] [V] [TRT] Tactic: 114 Time: 0.128242
[11/24/2022-12:10:03] [V] [TRT] Tactic: 116 Time: 31.0947
[11/24/2022-12:10:04] [V] [TRT] Tactic: 117 Time: 28.0505
[11/24/2022-12:10:04] [V] [TRT] Tactic: 118 Time: 3.22793
[11/24/2022-12:10:04] [V] [TRT] Fastest Tactic: 1 Time: 0.0739154
[11/24/2022-12:10:04] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:10:04] [V] [TRT] Tactic: 130477820174479366 Time: 7.49053
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:10:04] [V] [TRT] Tactic: 1358952225285826925 Time: 7.83029
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:04] [V] [TRT] Tactic: 4549827808004681195 Time: 7.29365
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:10:04] [V] [TRT] Tactic: 5127140674766136213 Time: 5.08618
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:10:04] [V] [TRT] Tactic: 5691674214365884252 Time: 14.1856
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:04] [V] [TRT] Tactic: 5779835512569528575 Time: 8.11547
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:10:04] [V] [TRT] Tactic: 6053873026024413720 Time: 8.24516
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:10:04] [V] [TRT] Tactic: 6532229230713743445 Time: 7.54416
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:10:04] [V] [TRT] Tactic: 6767548733843469815 Time: 7.45708
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:10:04] [V] [TRT] Tactic: -7777264329408437990 Time: 5.98869
[11/24/2022-12:10:04] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:10:05] [V] [TRT] Tactic: -6693149634808211969 Time: 5.33367
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:05] [V] [TRT] Tactic: -6313876406580483184 Time: 6.89433
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:10:05] [V] [TRT] Tactic: -4932505327461806800 Time: 14.6376
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:10:05] [V] [TRT] Tactic: -2870780723387717246 Time: 5.58111
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:05] [V] [TRT] Tactic: -1123676555321336786 Time: 8.19285
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:05] [V] [TRT] Tactic: -701551393537224327 Time: 7.64994
[11/24/2022-12:10:05] [V] [TRT] Fastest Tactic: 5127140674766136213 Time: 5.08618
[11/24/2022-12:10:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:10:05] [V] [TRT] *************** Autotuning format combination: Float(532224,1,24192,576) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:10:05] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:10:05] [V] [TRT] Tactic: 1852818056038333088 Time: 6.90035
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:10:05] [V] [TRT] Tactic: 2137271960938803767 Time: 9.65708
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:10:05] [V] [TRT] Tactic: 4543151729465212056 Time: 18.6304
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:10:05] [V] [TRT] Tactic: 5778138195697110002 Time: 3.83852
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:10:05] [V] [TRT] Tactic: 7098622778606028509 Time: 6.89605
[11/24/2022-12:10:05] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:10:06] [V] [TRT] Tactic: -9217704540809507511 Time: 15.9045
[11/24/2022-12:10:06] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:10:06] [V] [TRT] Tactic: -7734972403155710907 Time: 7.02555
[11/24/2022-12:10:06] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:10:06] [V] [TRT] Tactic: -3855385237722507463 Time: 3.90657
[11/24/2022-12:10:06] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:10:06] [V] [TRT] Tactic: -3360299822783115645 Time: 9.39809
[11/24/2022-12:10:06] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:10:06] [V] [TRT] Tactic: -2809379259463049392 Time: 3.88635
[11/24/2022-12:10:06] [V] [TRT] node_of_608 + node_of_609 + PWN(node_of_610) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:10:06] [V] [TRT] Tactic: -824800713406371346 Time: 9.34467
[11/24/2022-12:10:06] [V] [TRT] Fastest Tactic: 5778138195697110002 Time: 3.83852
[11/24/2022-12:10:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5778138195697110002
[11/24/2022-12:10:06] [V] [TRT] *************** Autotuning format combination: Float(133056,1:4,6048,144) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:10:06] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:06] [V] [TRT] *************** Autotuning format combination: Half(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:06] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudnnConvolution)
[11/24/2022-12:10:06] [V] [TRT] Tactic: 0 Time: 0.0638842
[11/24/2022-12:10:06] [V] [TRT] Tactic: 1 Time: 0.0639909
[11/24/2022-12:10:06] [V] [TRT] Tactic: 2 Time: 0.0999909
[11/24/2022-12:10:06] [V] [TRT] Tactic: 4 Time: 31.2608
[11/24/2022-12:10:06] [V] [TRT] Tactic: 5 Time: 28.2841
[11/24/2022-12:10:06] [V] [TRT] Tactic: 6 Time: 16.3321
[11/24/2022-12:10:07] [V] [TRT] Tactic: 56 Time: 0.0633737
[11/24/2022-12:10:07] [V] [TRT] Tactic: 58 Time: 0.0992686
[11/24/2022-12:10:07] [V] [TRT] Tactic: 60 Time: 30.8509
[11/24/2022-12:10:07] [V] [TRT] Tactic: 61 Time: 27.7471
[11/24/2022-12:10:07] [V] [TRT] Tactic: 62 Time: 16.4167
[11/24/2022-12:10:07] [V] [TRT] Fastest Tactic: 56 Time: 0.0633737
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Half(266112,924:2,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudaDepthwiseConvolution)
[11/24/2022-12:10:07] [V] [TRT] Tactic: -2 Time: 0.024611
[11/24/2022-12:10:07] [V] [TRT] Fastest Tactic: -2 Time: 0.024611
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Half(33264,1:16,1512,36) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Half(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudaDepthwiseConvolution)
[11/24/2022-12:10:07] [V] [TRT] Tactic: -5 Time: 0.13853
[11/24/2022-12:10:07] [V] [TRT] Fastest Tactic: -5 Time: 0.13853
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudaDepthwiseConvolution)
[11/24/2022-12:10:07] [V] [TRT] Tactic: -3 Time: 0.0152987
[11/24/2022-12:10:07] [V] [TRT] Fastest Tactic: -3 Time: 0.0152987
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Float(16632,924:32,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudaGroupConvolution)
[11/24/2022-12:10:07] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CudaDepthwiseConvolution)
[11/24/2022-12:10:07] [V] [TRT] Tactic: -4 Time: 0.0151086
[11/24/2022-12:10:07] [V] [TRT] Tactic: 0 Time: 0.0174649
[11/24/2022-12:10:07] [V] [TRT] Tactic: 1 Time: 0.0180691
[11/24/2022-12:10:07] [V] [TRT] Tactic: 2 Time: 0.0153317
[11/24/2022-12:10:07] [V] [TRT] Tactic: 3 Time: 0.0179326
[11/24/2022-12:10:07] [V] [TRT] Tactic: 4 Time: 0.0194594
[11/24/2022-12:10:07] [V] [TRT] Tactic: 5 Time: 0.018676
[11/24/2022-12:10:07] [V] [TRT] Tactic: 6 Time: 0.0232836
[11/24/2022-12:10:07] [V] [TRT] Tactic: 7 Time: 0.0205087
[11/24/2022-12:10:07] [V] [TRT] Tactic: 8 Time: 0.0341559
[11/24/2022-12:10:07] [V] [TRT] Tactic: 9 Time: 0.0314194
[11/24/2022-12:10:07] [V] [TRT] Tactic: 10 Time: 0.01792
[11/24/2022-12:10:07] [V] [TRT] Tactic: 11 Time: 0.0151698
[11/24/2022-12:10:07] [V] [TRT] Tactic: 12 Time: 0.0178777
[11/24/2022-12:10:07] [V] [TRT] Tactic: 13 Time: 0.0151058
[11/24/2022-12:10:07] [V] [TRT] Tactic: 14 Time: 0.0233345
[11/24/2022-12:10:07] [V] [TRT] Tactic: 15 Time: 0.0180469
[11/24/2022-12:10:07] [V] [TRT] Tactic: 16 Time: 0.0293705
[11/24/2022-12:10:07] [V] [TRT] Tactic: 17 Time: 0.0205388
[11/24/2022-12:10:07] [V] [TRT] Tactic: 18 Time: 0.0503909
[11/24/2022-12:10:07] [V] [TRT] Tactic: 19 Time: 0.0313737
[11/24/2022-12:10:07] [V] [TRT] Tactic: 20 Time: 0.0178863
[11/24/2022-12:10:07] [V] [TRT] Tactic: 21 Time: 0.0179714
[11/24/2022-12:10:07] [V] [TRT] Tactic: 22 Time: 0.0179114
[11/24/2022-12:10:07] [V] [TRT] Tactic: 23 Time: 0.0179491
[11/24/2022-12:10:07] [V] [TRT] Tactic: 24 Time: 0.0233737
[11/24/2022-12:10:07] [V] [TRT] Tactic: 25 Time: 0.020706
[11/24/2022-12:10:07] [V] [TRT] Tactic: 26 Time: 0.0290889
[11/24/2022-12:10:07] [V] [TRT] Tactic: 27 Time: 0.0235513
[11/24/2022-12:10:07] [V] [TRT] Tactic: 28 Time: 0.0501379
[11/24/2022-12:10:07] [V] [TRT] Tactic: 29 Time: 0.0393794
[11/24/2022-12:10:07] [V] [TRT] Tactic: 30 Time: 0.0153902
[11/24/2022-12:10:07] [V] [TRT] Tactic: 31 Time: 0.017757
[11/24/2022-12:10:07] [V] [TRT] Tactic: 32 Time: 0.0149106
[11/24/2022-12:10:07] [V] [TRT] Tactic: 33 Time: 0.015933
[11/24/2022-12:10:07] [V] [TRT] Tactic: 34 Time: 0.0179246
[11/24/2022-12:10:07] [V] [TRT] Tactic: 35 Time: 0.0178428
[11/24/2022-12:10:07] [V] [TRT] Tactic: 36 Time: 0.0223144
[11/24/2022-12:10:07] [V] [TRT] Tactic: 37 Time: 0.0181177
[11/24/2022-12:10:07] [V] [TRT] Tactic: 38 Time: 0.0339474
[11/24/2022-12:10:07] [V] [TRT] Tactic: 39 Time: 0.0287625
[11/24/2022-12:10:07] [V] [TRT] Tactic: 40 Time: 0.0153531
[11/24/2022-12:10:07] [V] [TRT] Tactic: 41 Time: 0.0150688
[11/24/2022-12:10:07] [V] [TRT] Tactic: 42 Time: 0.0172597
[11/24/2022-12:10:07] [V] [TRT] Tactic: 43 Time: 0.0147643
[11/24/2022-12:10:07] [V] [TRT] Tactic: 44 Time: 0.0208882
[11/24/2022-12:10:07] [V] [TRT] Tactic: 45 Time: 0.01804
[11/24/2022-12:10:07] [V] [TRT] Tactic: 46 Time: 0.0262225
[11/24/2022-12:10:07] [V] [TRT] Tactic: 47 Time: 0.0179589
[11/24/2022-12:10:07] [V] [TRT] Tactic: 48 Time: 0.0437417
[11/24/2022-12:10:07] [V] [TRT] Tactic: 49 Time: 0.0287433
[11/24/2022-12:10:07] [V] [TRT] Tactic: 50 Time: 0.0152379
[11/24/2022-12:10:07] [V] [TRT] Tactic: 51 Time: 0.0167187
[11/24/2022-12:10:07] [V] [TRT] Tactic: 52 Time: 0.016386
[11/24/2022-12:10:07] [V] [TRT] Tactic: 53 Time: 0.0153449
[11/24/2022-12:10:07] [V] [TRT] Tactic: 54 Time: 0.0208562
[11/24/2022-12:10:07] [V] [TRT] Tactic: 55 Time: 0.0184389
[11/24/2022-12:10:07] [V] [TRT] Tactic: 56 Time: 0.0261341
[11/24/2022-12:10:07] [V] [TRT] Tactic: 57 Time: 0.0207856
[11/24/2022-12:10:07] [V] [TRT] Tactic: 58 Time: 0.0431851
[11/24/2022-12:10:07] [V] [TRT] Tactic: 59 Time: 0.0341385
[11/24/2022-12:10:07] [V] [TRT] Fastest Tactic: 43 Time: 0.0147643
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_608 + node_of_609 + PWN(node_of_610) (CaskConvolution)
[11/24/2022-12:10:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: 43
[11/24/2022-12:10:07] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:07] [V] [TRT] *************** Autotuning format combination: Float(532224,924,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudaDepthwiseConvolution)
[11/24/2022-12:10:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (FusedConvActConvolution)
[11/24/2022-12:10:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:07] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudnnConvolution)
[11/24/2022-12:10:07] [V] [TRT] Tactic: 0 Time: 0.0905006
[11/24/2022-12:10:07] [V] [TRT] Tactic: 1 Time: 0.127198
[11/24/2022-12:10:07] [V] [TRT] Tactic: 2 Time: 0.348453
[11/24/2022-12:10:08] [V] [TRT] Tactic: 4 Time: 53.0131
[11/24/2022-12:10:08] [V] [TRT] Tactic: 5 Time: 0.63488
[11/24/2022-12:10:08] [V] [TRT] Tactic: 56 Time: 0.0864206
[11/24/2022-12:10:08] [V] [TRT] Tactic: 57 Time: 0.106823
[11/24/2022-12:10:08] [V] [TRT] Tactic: 58 Time: 0.287109
[11/24/2022-12:10:09] [V] [TRT] Tactic: 60 Time: 42.3153
[11/24/2022-12:10:09] [V] [TRT] Tactic: 61 Time: 0.634162
[11/24/2022-12:10:09] [V] [TRT] Tactic: 112 Time: 0.0860069
[11/24/2022-12:10:09] [V] [TRT] Tactic: 113 Time: 0.0860206
[11/24/2022-12:10:09] [V] [TRT] Tactic: 114 Time: 0.285947
[11/24/2022-12:10:10] [V] [TRT] Tactic: 116 Time: 42.2563
[11/24/2022-12:10:10] [V] [TRT] Tactic: 117 Time: 0.637659
[11/24/2022-12:10:10] [V] [TRT] Fastest Tactic: 112 Time: 0.0860069
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:10:10] [V] [TRT] Tactic: 621442388677115936 Time: 0.0307392
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:10:10] [V] [TRT] Tactic: 697756878388249475 Time: 0.0454891
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:10:10] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0319561
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:10:10] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0480701
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:10:10] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0664472
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:10:10] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0722354
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:10:10] [V] [TRT] Tactic: 3377996665278764661 Time: 0.12392
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:10:10] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0331429
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:10] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0794217
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:10:10] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0455166
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:10] [V] [TRT] Tactic: 5779835512569528575 Time: 0.10187
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:10:10] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0814011
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0852663
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0536945
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0393063
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0515139
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0287031
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0401657
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:10:10] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0634133
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:10:10] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0538362
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:10:10] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0799291
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:10:10] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0662842
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:10:10] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0670324
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:10:10] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0933463
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:10:10] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0602088
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:10:10] [V] [TRT] Tactic: -7070045993088702524 Time: 0.142046
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:10:10] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0539078
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:10] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0983771
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:10:10] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0998514
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:10:10] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0621806
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:10:10] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0765029
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:10:10] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0725074
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0643581
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1349585930542925704 Time: 0.041232
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1123676555321336786 Time: 0.103138
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:10] [V] [TRT] Tactic: -701551393537224327 Time: 0.0894606
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:10:10] [V] [TRT] Tactic: -3258434593395023 Time: 0.208763
[11/24/2022-12:10:10] [V] [TRT] Fastest Tactic: 6868013466259746979 Time: 0.0287031
[11/24/2022-12:10:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6868013466259746979
[11/24/2022-12:10:10] [V] [TRT] *************** Autotuning format combination: Float(532224,1,24192,576), Float(88704,1,4032,96) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:10] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0546164
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:10] [V] [TRT] Tactic: 1663866669559596164 Time: 0.104663
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:10] [V] [TRT] Tactic: 2860655430572478466 Time: 0.067453
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:10] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0553783
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:10] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0633844
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:10] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0638507
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:10] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0635505
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:10] [V] [TRT] Tactic: 5778138195697110003 Time: 0.101687
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0595459
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:10] [V] [TRT] Tactic: 8918020581761223752 Time: 0.103042
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:10] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0595002
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:10] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0548678
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:10] [V] [TRT] Tactic: -4896615592193611463 Time: 0.100181
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:10] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0537219
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:10] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0623025
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:10] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0539794
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:10] [V] [TRT] Tactic: -2809379259463049391 Time: 0.100231
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1985235291706575900 Time: 0.098192
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:10] [V] [TRT] Tactic: -504296718212024303 Time: 0.0961554
[11/24/2022-12:10:10] [V] [TRT] Fastest Tactic: -4056705536979434560 Time: 0.0537219
[11/24/2022-12:10:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4056705536979434560
[11/24/2022-12:10:10] [V] [TRT] *************** Autotuning format combination: Float(133056,1:4,6048,144), Float(22176,1:4,1008,24) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:10] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0349495
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:10] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0288192
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:10] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0228885
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:10] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0245935
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:10] [V] [TRT] Tactic: 5380043773350002416 Time: 0.020264
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:10] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0286693
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0266217
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0433006
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0434
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:10] [V] [TRT] Tactic: 6832381412128253616 Time: 0.020276
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:10] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0203011
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:10] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0307008
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:10] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0348233
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:10] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0266568
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:10] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0432537
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:10] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0199383
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:10] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0266552
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0430846
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0308233
[11/24/2022-12:10:10] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:10] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0203594
[11/24/2022-12:10:10] [V] [TRT] Fastest Tactic: -5033173285090644307 Time: 0.0199383
[11/24/2022-12:10:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5033173285090644307
[11/24/2022-12:10:10] [V] [TRT] *************** Autotuning format combination: Half(532224,924,42,1), Half(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:10:10] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudnnConvolution)
[11/24/2022-12:10:10] [V] [TRT] Tactic: 0 Time: 0.0909531
[11/24/2022-12:10:10] [V] [TRT] Tactic: 1 Time: 0.087888
[11/24/2022-12:10:10] [V] [TRT] Tactic: 2 Time: 0.194245
[11/24/2022-12:10:11] [V] [TRT] Tactic: 4 Time: 42.2766
[11/24/2022-12:10:11] [V] [TRT] Tactic: 5 Time: 0.628101
[11/24/2022-12:10:11] [V] [TRT] Tactic: 56 Time: 0.090576
[11/24/2022-12:10:11] [V] [TRT] Tactic: 58 Time: 0.193582
[11/24/2022-12:10:12] [V] [TRT] Tactic: 60 Time: 42.2628
[11/24/2022-12:10:12] [V] [TRT] Tactic: 61 Time: 0.625678
[11/24/2022-12:10:12] [V] [TRT] Fastest Tactic: 1 Time: 0.087888
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Half(266112,924:2,42,1), Half(44352,924:2,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (FusedConvActConvolution)
[11/24/2022-12:10:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72), Half(11088,1:8,504,12) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudaDepthwiseConvolution)
[11/24/2022-12:10:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:12] [V] [TRT] Tactic: 254850674756030979 Time: 0.0265059
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0265448
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0174258
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0264808
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0266545
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0136744
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0139744
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0139877
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1877373136269439559 Time: 0.016157
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0159309
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0137438
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0182629
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0244152
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0183794
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0141324
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0181371
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0140933
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0179737
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0307922
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0246552
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0137766
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0135863
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0138913
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0137338
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0244693
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0163815
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0181869
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0286967
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0244709
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0204336
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0135842
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0265669
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0266088
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0181297
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0161117
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0218273
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0135759
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0257935
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6377497238381488891 Time: 0.018104
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0139541
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0128968
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0161859
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0160538
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:12] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0288567
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:12] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0138992
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0179686
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8101703987960976805 Time: 0.016034
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0139312
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0210338
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0133519
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0267208
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:12] [V] [TRT] Tactic: -9203179519031456182 Time: 0.014021
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:12] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0223993
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:12] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0183069
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:12] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0259893
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:12] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0246011
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:12] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0134982
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:12] [V] [TRT] Tactic: -7410012245391920273 Time: 0.018208
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:12] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0134176
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:12] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0179166
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:12] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0161072
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:12] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0199949
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:12] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0138186
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0182371
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0144032
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0181446
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0138107
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0134138
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0265935
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0139009
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0137604
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0159949
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0138884
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0159314
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0287259
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0136378
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0137791
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0224216
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0200594
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3864869056275745423 Time: 0.020416
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0159025
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0160437
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0245707
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0138348
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:12] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0170926
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:12] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0176345
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:12] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0203691
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:12] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0138369
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:12] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0120385
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0218795
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0179914
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0138539
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0160234
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0124484
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1099247066487349374 Time: 0.018016
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0137621
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:12] [V] [TRT] Tactic: -406984317033388136 Time: 0.024531
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:12] [V] [TRT] Tactic: -331499326992534460 Time: 0.0138739
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:12] [V] [TRT] Tactic: -206523504474952360 Time: 0.0159604
[11/24/2022-12:10:12] [V] [TRT] Fastest Tactic: -2003055242756584050 Time: 0.0120385
[11/24/2022-12:10:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2003055242756584050
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Half(33264,1:16,1512,36), Half(5544,1:16,252,6) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Half(16632,924:32,42,1), Half(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CublasConvolution)
[11/24/2022-12:10:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudaDepthwiseConvolution)
[11/24/2022-12:10:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0433543
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0422411
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0431291
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0287397
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:12] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0288805
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:12] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0328622
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:12] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0305317
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0287515
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:12] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0350638
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0308846
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:12] [V] [TRT] Tactic: -108011214168778087 Time: 0.0336585
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:12] [V] [TRT] Tactic: -42427192380281294 Time: 0.0288247
[11/24/2022-12:10:12] [V] [TRT] Fastest Tactic: 5592640619112287921 Time: 0.0287397
[11/24/2022-12:10:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5592640619112287921
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1), Int8(22176,924:4,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudaDepthwiseConvolution)
[11/24/2022-12:10:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (FusedConvActConvolution)
[11/24/2022-12:10:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:12] [V] [TRT] Tactic: 175853789719975416 Time: 0.0329143
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0290194
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0266949
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:12] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0285379
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0392103
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:12] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0265912
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:12] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0316142
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:12] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0264389
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:12] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0266316
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:12] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0395989
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3326139578711341011 Time: 0.030795
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:12] [V] [TRT] Tactic: -683636008127039856 Time: 0.0406183
[11/24/2022-12:10:12] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0264389
[11/24/2022-12:10:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1), Int8(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:12] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0309787
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:12] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0393886
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0283848
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:12] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0402789
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:12] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0266651
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:12] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0307813
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0266309
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:12] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0392457
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3958182351168863467 Time: 0.026659
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:12] [V] [TRT] Tactic: -3111968753064955248 Time: 0.028757
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:12] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0329819
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:12] [V] [TRT] Tactic: -868495160148524802 Time: 0.0266377
[11/24/2022-12:10:12] [V] [TRT] Fastest Tactic: -4431642509665791294 Time: 0.0266309
[11/24/2022-12:10:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4431642509665791294
[11/24/2022-12:10:12] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:12] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:12] [V] [TRT] Tactic: 3426497547019031858 Time: 0.013898
[11/24/2022-12:10:12] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0137891
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0138356
[11/24/2022-12:10:13] [V] [TRT] Fastest Tactic: 5104832031493112835 Time: 0.0137891
[11/24/2022-12:10:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5104832031493112835
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Float(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0138086
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0113551
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:13] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0115418
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:13] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0183931
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0304439
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6556170942941957134 Time: 0.018352
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0135194
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0178433
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0124808
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0134554
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0100261
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0112865
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8912999970161746151 Time: 0.00997669
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8893439100868426414 Time: 0.013979
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0202743
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0183234
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0171713
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0288832
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0116209
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0186109
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0292014
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0114687
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0116972
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0201177
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0182617
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:13] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0133752
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0202949
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0199326
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0126171
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:13] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0137243
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1610768292520086910 Time: 0.020208
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:13] [V] [TRT] Tactic: -621838502160440068 Time: 0.0202914
[11/24/2022-12:10:13] [V] [TRT] Fastest Tactic: -8912999970161746151 Time: 0.00997669
[11/24/2022-12:10:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8912999970161746151
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Half(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:13] [V] [TRT] Tactic: 424230345342282109 Time: 0.0201863
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0118713
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0183491
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0102557
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:13] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0265364
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0116719
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0179166
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0180554
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0132135
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0264716
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00957989
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00939629
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8142426754608472547 Time: 0.011963
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0119375
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00974964
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:13] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0115949
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0117032
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0112004
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00974994
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0194811
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0183617
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0168386
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0159797
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0181589
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0114106
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00985783
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0182389
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0165338
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:13] [V] [TRT] Tactic: -2649556861007671996 Time: 0.01192
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1712174008006584201 Time: 0.026336
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0182554
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:13] [V] [TRT] Tactic: -50323486981480818 Time: 0.0184697
[11/24/2022-12:10:13] [V] [TRT] Fastest Tactic: 7796695344726998947 Time: 0.00939629
[11/24/2022-12:10:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7796695344726998947
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Int8(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudaGroupConvolution)
[11/24/2022-12:10:13] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CudaDepthwiseConvolution)
[11/24/2022-12:10:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (FusedConvActConvolution)
[11/24/2022-12:10:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_611 + node_of_612 + node_of_613 (CaskConvolution)
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:13] [V] [TRT] Tactic: 125145153013230687 Time: 0.0139782
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:13] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0111684
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:13] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0103569
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:13] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0108473
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00958537
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:13] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00972952
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:13] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00995809
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:13] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0118625
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:13] [V] [TRT] Tactic: 4112572034735311841 Time: 0.011897
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:13] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00933029
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:13] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0110442
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0111859
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00993402
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0116853
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0112679
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0139923
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0108813
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0119196
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0117405
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0138552
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00938743
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6793988781414507278 Time: 0.011706
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0117939
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:13] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0119966
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:13] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0111483
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0160975
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0160757
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8234775147403903473 Time: 0.017795
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00980937
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:13] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0108793
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:13] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00938771
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:13] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00988099
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0100958
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0112781
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:13] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0138992
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00979535
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0138942
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:13] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00927171
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:13] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00974537
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:13] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0202914
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:13] [V] [TRT] Tactic: -4182501876984672402 Time: 0.010848
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:13] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0139179
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0110396
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0119592
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:13] [V] [TRT] Tactic: -3288585994448820820 Time: 0.013839
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:13] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0112795
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:13] [V] [TRT] Tactic: -2432868635536396215 Time: 0.00988678
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:13] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0164698
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0117971
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0138776
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0115425
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00984015
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:13] [V] [TRT] Tactic: -405554772060757402 Time: 0.0112721
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:13] [V] [TRT] Tactic: -375949437730908730 Time: 0.00979931
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:13] [V] [TRT] Tactic: -111878368089469751 Time: 0.0203503
[11/24/2022-12:10:13] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:13] [V] [TRT] Tactic: -19707840769375107 Time: 0.0101559
[11/24/2022-12:10:13] [V] [TRT] Fastest Tactic: -5516472881360101487 Time: 0.00927171
[11/24/2022-12:10:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5516472881360101487
[11/24/2022-12:10:13] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(532224,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(532224,1,24192,576) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(133056,1:4,6048,144) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(532224,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(266112,924:2,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(33264,1:16,1512,36) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Float(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(532224,924,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(532224,1,24192,576), Float(88704,1,4032,96) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(133056,1:4,6048,144), Float(22176,1:4,1008,24) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(532224,924,42,1), Half(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(266112,924:2,42,1), Half(44352,924:2,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72), Half(11088,1:8,504,12) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(33264,1:16,1512,36), Half(5544,1:16,252,6) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(16632,924:32,42,1), Half(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1), Int8(22176,924:4,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1), Int8(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Float(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Half(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1), Int8(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(532224,1,24192,576) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(133056,1:4,6048,144) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(266112,924:2,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(66528,1:8,3024,72) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(33264,1:16,1512,36) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(133056,924:4,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(532224,924,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(16632,924:32,42,1) ***************
[11/24/2022-12:10:13] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:13] [V] [TRT] *************** Autotuning format combination: Float(532224,924,42,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudaDepthwiseConvolution)
[11/24/2022-12:10:13] [V] [TRT] Tactic: -1 Time: 0.0231758
[11/24/2022-12:10:13] [V] [TRT] Fastest Tactic: -1 Time: 0.0231758
[11/24/2022-12:10:13] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudnnConvolution)
[11/24/2022-12:10:13] [V] [TRT] Tactic: 0 Time: 0.0427623
[11/24/2022-12:10:13] [V] [TRT] Tactic: 1 Time: 0.0442046
[11/24/2022-12:10:13] [V] [TRT] Tactic: 2 Time: 0.0414857
[11/24/2022-12:10:13] [V] [TRT] Tactic: 5 Time: 28.2947
[11/24/2022-12:10:13] [V] [TRT] Tactic: 56 Time: 0.0420869
[11/24/2022-12:10:13] [V] [TRT] Tactic: 57 Time: 0.0421966
[11/24/2022-12:10:13] [V] [TRT] Tactic: 58 Time: 0.0416023
[11/24/2022-12:10:14] [V] [TRT] Tactic: 61 Time: 28.486
[11/24/2022-12:10:14] [V] [TRT] Tactic: 112 Time: 0.041232
[11/24/2022-12:10:14] [V] [TRT] Tactic: 113 Time: 0.0428411
[11/24/2022-12:10:14] [V] [TRT] Tactic: 114 Time: 0.0424297
[11/24/2022-12:10:14] [V] [TRT] Tactic: 117 Time: 27.8254
[11/24/2022-12:10:14] [V] [TRT] Fastest Tactic: 112 Time: 0.041232
[11/24/2022-12:10:14] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:10:14] [V] [TRT] Tactic: 130477820174479366 Time: 6.90843
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:10:14] [V] [TRT] Tactic: 1358952225285826925 Time: 7.32502
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:14] [V] [TRT] Tactic: 4549827808004681195 Time: 6.91385
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:10:14] [V] [TRT] Tactic: 5127140674766136213 Time: 4.8065
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:10:14] [V] [TRT] Tactic: 5691674214365884252 Time: 13.5181
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:14] [V] [TRT] Tactic: 5779835512569528575 Time: 7.78437
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:10:14] [V] [TRT] Tactic: 6053873026024413720 Time: 7.85289
[11/24/2022-12:10:14] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:10:15] [V] [TRT] Tactic: 6532229230713743445 Time: 6.93796
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:10:15] [V] [TRT] Tactic: 6767548733843469815 Time: 7.02107
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:10:15] [V] [TRT] Tactic: -6693149634808211969 Time: 4.8289
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:15] [V] [TRT] Tactic: -6313876406580483184 Time: 6.5932
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:10:15] [V] [TRT] Tactic: -4932505327461806800 Time: 14.0352
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:10:15] [V] [TRT] Tactic: -2870780723387717246 Time: 5.41555
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:15] [V] [TRT] Tactic: -1123676555321336786 Time: 7.84175
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:15] [V] [TRT] Tactic: -701551393537224327 Time: 6.97523
[11/24/2022-12:10:15] [V] [TRT] Fastest Tactic: 5127140674766136213 Time: 4.8065
[11/24/2022-12:10:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:10:15] [V] [TRT] *************** Autotuning format combination: Float(532224,1,24192,576) -> Float(133056,1,12096,576) ***************
[11/24/2022-12:10:15] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:10:15] [V] [TRT] Tactic: 1852818056038333088 Time: 6.67847
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:10:15] [V] [TRT] Tactic: 2137271960938803767 Time: 9.27792
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:10:15] [V] [TRT] Tactic: 4543151729465212056 Time: 15.8577
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:10:15] [V] [TRT] Tactic: 5778138195697110002 Time: 0.962217
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:10:15] [V] [TRT] Tactic: 7098622778606028509 Time: 6.62693
[11/24/2022-12:10:15] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:10:16] [V] [TRT] Tactic: -9217704540809507511 Time: 15.539
[11/24/2022-12:10:16] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:10:16] [V] [TRT] Tactic: -7734972403155710907 Time: 6.52513
[11/24/2022-12:10:16] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:10:16] [V] [TRT] Tactic: -3855385237722507463 Time: 0.978811
[11/24/2022-12:10:16] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:10:16] [V] [TRT] Tactic: -3360299822783115645 Time: 8.89007
[11/24/2022-12:10:16] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:10:16] [V] [TRT] Tactic: -2809379259463049392 Time: 0.970807
[11/24/2022-12:10:16] [V] [TRT] node_of_626 + node_of_627 + PWN(node_of_628) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:10:16] [V] [TRT] Tactic: -824800713406371346 Time: 9.19125
[11/24/2022-12:10:16] [V] [TRT] Fastest Tactic: 5778138195697110002 Time: 0.962217
[11/24/2022-12:10:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5778138195697110002
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Float(133056,1:4,6048,144) -> Float(33264,1:4,3024,144) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Half(532224,924,42,1) -> Half(133056,231,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudnnConvolution)
[11/24/2022-12:10:16] [V] [TRT] Tactic: 0 Time: 0.0424343
[11/24/2022-12:10:16] [V] [TRT] Tactic: 1 Time: 0.0400994
[11/24/2022-12:10:16] [V] [TRT] Tactic: 2 Time: 0.0396091
[11/24/2022-12:10:16] [V] [TRT] Tactic: 5 Time: 27.8228
[11/24/2022-12:10:16] [V] [TRT] Tactic: 56 Time: 0.0395257
[11/24/2022-12:10:16] [V] [TRT] Tactic: 58 Time: 0.040224
[11/24/2022-12:10:16] [V] [TRT] Tactic: 61 Time: 27.8235
[11/24/2022-12:10:16] [V] [TRT] Fastest Tactic: 56 Time: 0.0395257
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Half(266112,924:2,42,1) -> Half(66528,231:2,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72) -> Float(133056,231,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Half(66528,1:8,3024,72) -> Half(16632,1:8,1512,72) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudaDepthwiseConvolution)
[11/24/2022-12:10:16] [V] [TRT] Tactic: -2 Time: 0.0148379
[11/24/2022-12:10:16] [V] [TRT] Fastest Tactic: -2 Time: 0.0148379
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Half(33264,1:16,1512,36) -> Half(8316,1:16,756,36) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Half(16632,924:32,42,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudaDepthwiseConvolution)
[11/24/2022-12:10:16] [V] [TRT] Tactic: -5 Time: 0.039408
[11/24/2022-12:10:16] [V] [TRT] Fastest Tactic: -5 Time: 0.039408
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Int8(33264,231:4,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudaDepthwiseConvolution)
[11/24/2022-12:10:16] [V] [TRT] Tactic: -3 Time: 0.00961615
[11/24/2022-12:10:16] [V] [TRT] Fastest Tactic: -3 Time: 0.00961615
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(133056,924:4,42,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Float(133056,231,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Float(4158,231:32,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Half(4158,231:32,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Int8(16632,924:32,42,1) -> Int8(4158,231:32,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudaGroupConvolution)
[11/24/2022-12:10:16] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CudaDepthwiseConvolution)
[11/24/2022-12:10:16] [V] [TRT] Tactic: -4 Time: 0.00953173
[11/24/2022-12:10:16] [V] [TRT] Tactic: 0 Time: 0.0118277
[11/24/2022-12:10:16] [V] [TRT] Tactic: 1 Time: 0.0126952
[11/24/2022-12:10:16] [V] [TRT] Tactic: 2 Time: 0.0128347
[11/24/2022-12:10:16] [V] [TRT] Tactic: 3 Time: 0.012619
[11/24/2022-12:10:16] [V] [TRT] Tactic: 4 Time: 0.0163383
[11/24/2022-12:10:16] [V] [TRT] Tactic: 5 Time: 0.0153381
[11/24/2022-12:10:16] [V] [TRT] Tactic: 6 Time: 0.023439
[11/24/2022-12:10:16] [V] [TRT] Tactic: 7 Time: 0.0233332
[11/24/2022-12:10:16] [V] [TRT] Tactic: 8 Time: 0.0395931
[11/24/2022-12:10:16] [V] [TRT] Tactic: 9 Time: 0.0384994
[11/24/2022-12:10:16] [V] [TRT] Tactic: 10 Time: 0.0123848
[11/24/2022-12:10:16] [V] [TRT] Tactic: 11 Time: 0.0109538
[11/24/2022-12:10:16] [V] [TRT] Tactic: 12 Time: 0.0150139
[11/24/2022-12:10:16] [V] [TRT] Tactic: 13 Time: 0.0125112
[11/24/2022-12:10:16] [V] [TRT] Tactic: 14 Time: 0.017996
[11/24/2022-12:10:16] [V] [TRT] Tactic: 15 Time: 0.0153518
[11/24/2022-12:10:16] [V] [TRT] Tactic: 16 Time: 0.0272587
[11/24/2022-12:10:16] [V] [TRT] Tactic: 17 Time: 0.0232816
[11/24/2022-12:10:16] [V] [TRT] Tactic: 18 Time: 0.0451154
[11/24/2022-12:10:16] [V] [TRT] Tactic: 19 Time: 0.0372343
[11/24/2022-12:10:16] [V] [TRT] Tactic: 20 Time: 0.0124198
[11/24/2022-12:10:16] [V] [TRT] Tactic: 21 Time: 0.0123128
[11/24/2022-12:10:16] [V] [TRT] Tactic: 22 Time: 0.0152215
[11/24/2022-12:10:16] [V] [TRT] Tactic: 23 Time: 0.0148736
[11/24/2022-12:10:16] [V] [TRT] Tactic: 24 Time: 0.0180011
[11/24/2022-12:10:16] [V] [TRT] Tactic: 25 Time: 0.0172815
[11/24/2022-12:10:16] [V] [TRT] Tactic: 26 Time: 0.0284503
[11/24/2022-12:10:16] [V] [TRT] Tactic: 27 Time: 0.0257813
[11/24/2022-12:10:16] [V] [TRT] Tactic: 28 Time: 0.0450469
[11/24/2022-12:10:16] [V] [TRT] Tactic: 29 Time: 0.0420766
[11/24/2022-12:10:16] [V] [TRT] Fastest Tactic: -4 Time: 0.00953173
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_626 + node_of_627 + PWN(node_of_628) (CaskConvolution)
[11/24/2022-12:10:16] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -4
[11/24/2022-12:10:16] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:16] [V] [TRT] *************** Autotuning format combination: Float(133056,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudaDepthwiseConvolution)
[11/24/2022-12:10:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:16] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (FusedConvActConvolution)
[11/24/2022-12:10:16] [V] [TRT] Tactic: 589823 Time: 0.165586
[11/24/2022-12:10:16] [V] [TRT] Tactic: 655359 Time: 0.107529
[11/24/2022-12:10:16] [V] [TRT] Tactic: 786431 Time: 0.0577219
[11/24/2022-12:10:16] [V] [TRT] Tactic: 851967 Time: 0.050621
[11/24/2022-12:10:16] [V] [TRT] Tactic: 1179647 Time: 0.0504853
[11/24/2022-12:10:16] [V] [TRT] Tactic: 1638399 Time: 0.0533303
[11/24/2022-12:10:16] [V] [TRT] Tactic: 2097151 Time: 0.0395531
[11/24/2022-12:10:17] [V] [TRT] Tactic: 3538943 Time: 0.0507261
[11/24/2022-12:10:17] [V] [TRT] Tactic: 3932159 Time: 0.0973349
[11/24/2022-12:10:17] [V] [TRT] Tactic: 3997695 Time: 0.0531749
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4194303 Time: 0.0531429
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4259839 Time: 0.0424629
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4587519 Time: 0.0454926
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4653055 Time: 0.0565943
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4915199 Time: 0.0396469
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4980735 Time: 0.0675352
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5177343 Time: 0.0508404
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5242879 Time: 0.0610286
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5373951 Time: 0.0594377
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5570559 Time: 0.0782697
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5767167 Time: 0.0640869
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5898239 Time: 0.0369737
[11/24/2022-12:10:17] [V] [TRT] Tactic: 6225919 Time: 0.0452514
[11/24/2022-12:10:17] [V] [TRT] Tactic: 6291455 Time: 0.0503101
[11/24/2022-12:10:17] [V] [TRT] Tactic: 6815743 Time: 0.0655924
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7012351 Time: 0.0396514
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7077887 Time: 0.0503558
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7143423 Time: 0.0609067
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7208959 Time: 0.0666819
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7340031 Time: 0.0588389
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7536639 Time: 0.0893623
[11/24/2022-12:10:17] [V] [TRT] Tactic: 7733247 Time: 0.0565836
[11/24/2022-12:10:17] [V] [TRT] Tactic: 8191999 Time: 0.0540891
[11/24/2022-12:10:17] [V] [TRT] Tactic: 8716287 Time: 0.0515398
[11/24/2022-12:10:17] [V] [TRT] Tactic: 9109503 Time: 0.0479101
[11/24/2022-12:10:17] [V] [TRT] Tactic: 9568255 Time: 0.0395006
[11/24/2022-12:10:17] [V] [TRT] Tactic: 10354687 Time: 0.044968
[11/24/2022-12:10:17] [V] [TRT] Tactic: 10747903 Time: 0.0480731
[11/24/2022-12:10:17] [V] [TRT] Fastest Tactic: 5898239 Time: 0.0369737
[11/24/2022-12:10:17] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudnnConvolution)
[11/24/2022-12:10:17] [V] [TRT] Tactic: 0 Time: 0.0561951
[11/24/2022-12:10:17] [V] [TRT] Tactic: 1 Time: 0.0887794
[11/24/2022-12:10:17] [V] [TRT] Tactic: 2 Time: 0.129138
[11/24/2022-12:10:17] [V] [TRT] Tactic: 4 Time: 7.25287
[11/24/2022-12:10:17] [V] [TRT] Tactic: 5 Time: 0.683689
[11/24/2022-12:10:17] [V] [TRT] Tactic: 56 Time: 0.0563383
[11/24/2022-12:10:17] [V] [TRT] Tactic: 57 Time: 0.0849669
[11/24/2022-12:10:17] [V] [TRT] Tactic: 58 Time: 0.129701
[11/24/2022-12:10:17] [V] [TRT] Tactic: 60 Time: 7.25463
[11/24/2022-12:10:17] [V] [TRT] Tactic: 61 Time: 0.681426
[11/24/2022-12:10:17] [V] [TRT] Tactic: 112 Time: 0.0563566
[11/24/2022-12:10:17] [V] [TRT] Tactic: 113 Time: 0.0558674
[11/24/2022-12:10:17] [V] [TRT] Tactic: 114 Time: 0.129262
[11/24/2022-12:10:18] [V] [TRT] Tactic: 116 Time: 7.25481
[11/24/2022-12:10:18] [V] [TRT] Tactic: 117 Time: 0.682798
[11/24/2022-12:10:18] [V] [TRT] Fastest Tactic: 113 Time: 0.0558674
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:10:18] [V] [TRT] Tactic: 621442388677115936 Time: 0.028747
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:10:18] [V] [TRT] Tactic: 697756878388249475 Time: 0.0315877
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:10:18] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0316142
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:10:18] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0340709
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:10:18] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0401623
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:10:18] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0640381
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:10:18] [V] [TRT] Tactic: 3377996665278764661 Time: 0.117474
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0341787
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0783863
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4918658762935651592 Time: 0.042992
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5779835512569528575 Time: 0.100642
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0734606
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6166883504066133838 Time: 0.050656
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0524556
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0371223
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0500373
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0262187
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0213812
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:10:18] [V] [TRT] Tactic: 8048119769507926928 Time: 0.051712
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:10:18] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0443383
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:10:18] [V] [TRT] Tactic: -8877086111929938764 Time: 0.072
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:10:18] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0396206
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:10:18] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0639284
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:10:18] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0928526
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:10:18] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0602987
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:10:18] [V] [TRT] Tactic: -7070045993088702524 Time: 0.115886
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:10:18] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0424971
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:18] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0968206
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:10:18] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0990789
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:10:18] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0610347
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:10:18] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0749531
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:10:18] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0637973
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0643642
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0233417
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1123676555321336786 Time: 0.102016
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:18] [V] [TRT] Tactic: -701551393537224327 Time: 0.0828594
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:10:18] [V] [TRT] Tactic: -3258434593395023 Time: 0.201879
[11/24/2022-12:10:18] [V] [TRT] Fastest Tactic: 6901214267543238617 Time: 0.0213812
[11/24/2022-12:10:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6901214267543238617
[11/24/2022-12:10:18] [V] [TRT] *************** Autotuning format combination: Float(133056,1,12096,576) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:18] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0542598
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:18] [V] [TRT] Tactic: 1663866669559596164 Time: 0.101095
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:18] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0617051
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:18] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0537295
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0370457
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0374137
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0630232
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5778138195697110003 Time: 0.101744
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0344567
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:18] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0969989
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:18] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0345326
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:18] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0545006
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:18] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0944389
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:18] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0532419
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:18] [V] [TRT] Tactic: -4035591156787122265 Time: 0.035928
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:18] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0532952
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:18] [V] [TRT] Tactic: -2809379259463049391 Time: 0.100576
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0970926
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:18] [V] [TRT] Tactic: -504296718212024303 Time: 0.0952526
[11/24/2022-12:10:18] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0344567
[11/24/2022-12:10:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:10:18] [V] [TRT] *************** Autotuning format combination: Float(33264,1:4,3024,144) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:18] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0343141
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:18] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0288027
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:18] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0183583
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0153477
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0183651
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0284571
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0261768
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0424469
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0423246
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:18] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0203777
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:18] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0202983
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:18] [V] [TRT] Tactic: -8853476220903838035 Time: 0.020674
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:18] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0343095
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:18] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0154336
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:18] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0427611
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:18] [V] [TRT] Tactic: -5033173285090644307 Time: 0.020388
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:18] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0262469
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1450865838092804082 Time: 0.042368
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0210194
[11/24/2022-12:10:18] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:18] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0201846
[11/24/2022-12:10:18] [V] [TRT] Fastest Tactic: 5108195418077987197 Time: 0.0153477
[11/24/2022-12:10:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5108195418077987197
[11/24/2022-12:10:18] [V] [TRT] *************** Autotuning format combination: Half(133056,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:10:18] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudnnConvolution)
[11/24/2022-12:10:18] [V] [TRT] Tactic: 0 Time: 0.0803131
[11/24/2022-12:10:18] [V] [TRT] Tactic: 1 Time: 0.0605318
[11/24/2022-12:10:18] [V] [TRT] Tactic: 2 Time: 0.180096
[11/24/2022-12:10:18] [V] [TRT] Tactic: 4 Time: 7.2271
[11/24/2022-12:10:18] [V] [TRT] Tactic: 5 Time: 0.655429
[11/24/2022-12:10:18] [V] [TRT] Tactic: 56 Time: 0.08024
[11/24/2022-12:10:18] [V] [TRT] Tactic: 58 Time: 0.180539
[11/24/2022-12:10:18] [V] [TRT] Tactic: 60 Time: 7.23474
[11/24/2022-12:10:19] [V] [TRT] Tactic: 61 Time: 0.651643
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: 1 Time: 0.0605318
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Half(66528,231:2,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Half(66528,231:2,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (FusedConvActConvolution)
[11/24/2022-12:10:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Half(16632,1:8,1512,72) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Half(16632,1:8,1512,72) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudaDepthwiseConvolution)
[11/24/2022-12:10:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:19] [V] [TRT] Tactic: 254850674756030979 Time: 0.0263223
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0262491
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0178657
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0261432
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0262705
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1576319725282257846 Time: 0.013361
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0143346
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0127128
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0175441
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0120335
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0127139
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0180211
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0240389
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0121436
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0141432
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3071479995783211391 Time: 0.011928
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0150907
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0177564
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0315145
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0250164
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3899310434460415852 Time: 0.00968929
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0128488
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0150638
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0127086
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0251756
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0175685
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0180606
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0289755
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0235807
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0204153
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4993757826442493905 Time: 0.012608
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0259413
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0261935
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0179023
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0175279
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0207386
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0126069
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0261227
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0176696
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0149897
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0126358
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0176579
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6859477213531075460 Time: 0.011987
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0286363
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0126949
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0177448
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0120823
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0148379
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0208751
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0120522
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0260724
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:19] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0107386
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:19] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0207785
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0120949
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0261798
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0256427
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0123166
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0118854
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0126164
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0117145
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0158592
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0122564
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0132085
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0180109
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0117078
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0178692
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0128903
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0125086
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0262004
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0100407
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0147342
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0119112
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4379519430184503304 Time: 0.012773
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0116958
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0289134
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0127013
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0144974
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0224529
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0184931
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0205453
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0119036
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0174283
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0259581
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0129429
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0176676
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0176432
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0204153
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0127688
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0124305
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208647
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0120754
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0127025
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0168833
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0124248
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0118818
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0126011
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:19] [V] [TRT] Tactic: -406984317033388136 Time: 0.0236206
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:19] [V] [TRT] Tactic: -331499326992534460 Time: 0.0124091
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:19] [V] [TRT] Tactic: -206523504474952360 Time: 0.0173557
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.00968929
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Half(8316,1:16,756,36) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Half(4158,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CublasConvolution)
[11/24/2022-12:10:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(33264,231:4,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudaDepthwiseConvolution)
[11/24/2022-12:10:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0422834
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0423817
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0424
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0287141
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0287735
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6580271968881459581 Time: 0.031829
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0291703
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0288814
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0344704
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1425085658556684465 Time: 0.031371
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:19] [V] [TRT] Tactic: -108011214168778087 Time: 0.0325989
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:19] [V] [TRT] Tactic: -42427192380281294 Time: 0.0289152
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: 5592640619112287921 Time: 0.0287141
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5592640619112287921
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(33264,231:4,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudaDepthwiseConvolution)
[11/24/2022-12:10:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (FusedConvActConvolution)
[11/24/2022-12:10:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:19] [V] [TRT] Tactic: 175853789719975416 Time: 0.0315045
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0288091
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0259893
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0261981
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6299962968199310600 Time: 0.038096
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0260366
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0298587
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0247307
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7303593854972602201 Time: 0.025997
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0395703
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0289298
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:19] [V] [TRT] Tactic: -683636008127039856 Time: 0.0397154
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0247307
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(33264,231:4,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0294373
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2855900226702061782 Time: 0.038344
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0262057
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0396926
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0240861
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0289161
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0259307
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0392434
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3958182351168863467 Time: 0.025981
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0287689
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0316389
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:19] [V] [TRT] Tactic: -868495160148524802 Time: 0.0260419
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0240861
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(4158,231:32,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0102096
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5104832031493112835 Time: 0.013952
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0107804
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0102096
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(4158,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0148809
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0115945
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00933543
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0179937
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0286747
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0181171
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6618077155362058131 Time: 0.00939829
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0203806
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7348718297764976805 Time: 0.00963901
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7869897696365535632 Time: 0.00931343
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0113132
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0103644
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0114796
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0149166
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0210984
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0180126
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0197983
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0274613
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00926314
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0179846
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7282232519526877434 Time: 0.028163
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00924286
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6406011580107094428 Time: 0.00926971
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5603587790314027122 Time: 0.018364
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0180971
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0150423
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0230694
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0181651
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3502495740607894730 Time: 0.00964419
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2342404147487779225 Time: 0.015157
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0198354
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:19] [V] [TRT] Tactic: -621838502160440068 Time: 0.0204454
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.00924286
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(4158,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:19] [V] [TRT] Tactic: 424230345342282109 Time: 0.0198537
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0120781
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2327398338581585326 Time: 0.018228
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2881044142075831475 Time: 0.00903629
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0261524
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5730376045873629665 Time: 0.00937486
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0175736
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0179697
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0122621
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0261524
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0095811
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7796695344726998947 Time: 0.009422
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0120872
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00935971
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00937514
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:19] [V] [TRT] Tactic: 9072692108481390634 Time: 0.00942629
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0120293
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00926229
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00915486
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0188686
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0181817
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0174303
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0161143
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0180286
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00926086
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0095488
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0179943
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3514726588976755320 Time: 0.017441
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00968168
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0262964
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0180486
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:19] [V] [TRT] Tactic: -50323486981480818 Time: 0.0181583
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: 2881044142075831475 Time: 0.00903629
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2881044142075831475
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Int8(4158,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudaGroupConvolution)
[11/24/2022-12:10:19] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CudaDepthwiseConvolution)
[11/24/2022-12:10:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (FusedConvActConvolution)
[11/24/2022-12:10:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_629 + node_of_630 (CaskConvolution)
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:19] [V] [TRT] Tactic: 125145153013230687 Time: 0.0148059
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0101102
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0100209
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00934486
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00959634
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00908914
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00916714
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:19] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00938771
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00922686
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00927829
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:19] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0099072
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00914914
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00992701
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0120941
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:19] [V] [TRT] Tactic: 5986622376339202983 Time: 0.009146
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0148133
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0100404
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0120792
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00936
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0146798
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00936971
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0118674
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0121581
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:19] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0122187
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:19] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0101093
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0156507
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0154286
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8234775147403903473 Time: 0.017474
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00984655
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:19] [V] [TRT] Tactic: 8765382722978397630 Time: 0.00998796
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:19] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00940057
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:19] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00912914
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0100209
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00903457
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:19] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0148288
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00972343
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0148311
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:19] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00925
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00900314
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0177991
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00990232
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:19] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0148165
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3825889760337461729 Time: 0.009306
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00942571
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:19] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0146734
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00986484
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0100206
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:19] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0173359
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0121794
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1549742793039499659 Time: 0.014795
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1328736756812546664 Time: 0.00927543
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:19] [V] [TRT] Tactic: -1006589727652607355 Time: 0.008932
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:19] [V] [TRT] Tactic: -405554772060757402 Time: 0.00932514
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:19] [V] [TRT] Tactic: -375949437730908730 Time: 0.00943257
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:19] [V] [TRT] Tactic: -111878368089469751 Time: 0.0176869
[11/24/2022-12:10:19] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:19] [V] [TRT] Tactic: -19707840769375107 Time: 0.00945714
[11/24/2022-12:10:19] [V] [TRT] Fastest Tactic: -1006589727652607355 Time: 0.008932
[11/24/2022-12:10:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1006589727652607355
[11/24/2022-12:10:19] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:19] [V] [TRT] *************** Autotuning format combination: Float(36960,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudaDepthwiseConvolution)
[11/24/2022-12:10:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:19] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (FusedConvActConvolution)
[11/24/2022-12:10:19] [V] [TRT] Tactic: 589823 Time: 0.141129
[11/24/2022-12:10:19] [V] [TRT] Tactic: 655359 Time: 0.089504
[11/24/2022-12:10:19] [V] [TRT] Tactic: 786431 Time: 0.0957143
[11/24/2022-12:10:19] [V] [TRT] Tactic: 851967 Time: 0.0811108
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1179647 Time: 0.0815497
[11/24/2022-12:10:19] [V] [TRT] Tactic: 1638399 Time: 0.0979909
[11/24/2022-12:10:19] [V] [TRT] Tactic: 2097151 Time: 0.0789463
[11/24/2022-12:10:20] [V] [TRT] Tactic: 3538943 Time: 0.0827703
[11/24/2022-12:10:20] [V] [TRT] Tactic: 3932159 Time: 0.0905966
[11/24/2022-12:10:20] [V] [TRT] Tactic: 3997695 Time: 0.0919611
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4194303 Time: 0.0808366
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4259839 Time: 0.082752
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4587519 Time: 0.0779703
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4653055 Time: 0.0835086
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4915199 Time: 0.0784297
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4980735 Time: 0.0917463
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5177343 Time: 0.0831474
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5242879 Time: 0.0795863
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5373951 Time: 0.0961554
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5570559 Time: 0.0805897
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5767167 Time: 0.127374
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5898239 Time: 0.0829189
[11/24/2022-12:10:20] [V] [TRT] Tactic: 6225919 Time: 0.0722743
[11/24/2022-12:10:20] [V] [TRT] Tactic: 6291455 Time: 0.0816731
[11/24/2022-12:10:20] [V] [TRT] Tactic: 6815743 Time: 0.0887131
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7012351 Time: 0.0791383
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7077887 Time: 0.07792
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7143423 Time: 0.110082
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7208959 Time: 0.0869623
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7340031 Time: 0.0907611
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7536639 Time: 0.0968114
[11/24/2022-12:10:20] [V] [TRT] Tactic: 7733247 Time: 0.0883474
[11/24/2022-12:10:20] [V] [TRT] Tactic: 8191999 Time: 0.0850971
[11/24/2022-12:10:20] [V] [TRT] Tactic: 8716287 Time: 0.0804823
[11/24/2022-12:10:20] [V] [TRT] Tactic: 9109503 Time: 0.097984
[11/24/2022-12:10:20] [V] [TRT] Tactic: 9568255 Time: 0.0773669
[11/24/2022-12:10:20] [V] [TRT] Tactic: 10354687 Time: 0.0868434
[11/24/2022-12:10:20] [V] [TRT] Tactic: 10747903 Time: 0.0830903
[11/24/2022-12:10:20] [V] [TRT] Fastest Tactic: 6225919 Time: 0.0722743
[11/24/2022-12:10:20] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudnnConvolution)
[11/24/2022-12:10:20] [V] [TRT] Tactic: 0 Time: 0.078992
[11/24/2022-12:10:20] [V] [TRT] Tactic: 1 Time: 0.123899
[11/24/2022-12:10:20] [V] [TRT] Tactic: 2 Time: 0.127099
[11/24/2022-12:10:20] [V] [TRT] Tactic: 4 Time: 12.0853
[11/24/2022-12:10:20] [V] [TRT] Tactic: 5 Time: 0.869554
[11/24/2022-12:10:20] [V] [TRT] Tactic: 56 Time: 0.0791611
[11/24/2022-12:10:20] [V] [TRT] Tactic: 57 Time: 0.122437
[11/24/2022-12:10:20] [V] [TRT] Tactic: 58 Time: 0.127449
[11/24/2022-12:10:21] [V] [TRT] Tactic: 60 Time: 12.0776
[11/24/2022-12:10:21] [V] [TRT] Tactic: 61 Time: 0.753957
[11/24/2022-12:10:21] [V] [TRT] Tactic: 112 Time: 0.0770766
[11/24/2022-12:10:21] [V] [TRT] Tactic: 113 Time: 0.0774331
[11/24/2022-12:10:21] [V] [TRT] Tactic: 114 Time: 0.12331
[11/24/2022-12:10:21] [V] [TRT] Tactic: 116 Time: 10.2574
[11/24/2022-12:10:21] [V] [TRT] Tactic: 117 Time: 0.753906
[11/24/2022-12:10:21] [V] [TRT] Fastest Tactic: 112 Time: 0.0770766
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:10:21] [V] [TRT] Tactic: 621442388677115936 Time: 0.0307264
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:10:21] [V] [TRT] Tactic: 697756878388249475 Time: 0.0560457
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:10:21] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0304649
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:10:21] [V] [TRT] Tactic: 1327459216264546184 Time: 0.064125
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:10:21] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0452034
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:10:21] [V] [TRT] Tactic: 2310520233542099555 Time: 0.032587
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:10:21] [V] [TRT] Tactic: 3377996665278764661 Time: 0.046112
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:10:21] [V] [TRT] Tactic: 4032904638566464623 Time: 0.032779
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:21] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0409714
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:10:21] [V] [TRT] Tactic: 4918658762935651592 Time: 0.048416
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:21] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0368171
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:10:21] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0368377
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0263139
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0266065
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0370286
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0252686
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6868013466259746979 Time: 0.026467
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0389211
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:10:21] [V] [TRT] Tactic: 8048119769507926928 Time: 0.028496
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:10:21] [V] [TRT] Tactic: 9151672657204310840 Time: 0.024237
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:10:21] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0347666
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:10:21] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0451703
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:10:21] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0413589
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:10:21] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0423497
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:10:21] [V] [TRT] Tactic: -7145578994937510651 Time: 0.041064
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:10:21] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0451806
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:10:21] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0223079
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:21] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0452937
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:10:21] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0358434
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:10:21] [V] [TRT] Tactic: -4562045946847239058 Time: 0.041056
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:10:21] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0367189
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:10:21] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0328786
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0420754
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0444514
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0370206
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:21] [V] [TRT] Tactic: -701551393537224327 Time: 0.041064
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:10:21] [V] [TRT] Tactic: -3258434593395023 Time: 0.0700907
[11/24/2022-12:10:21] [V] [TRT] Fastest Tactic: -6622064180404051845 Time: 0.0223079
[11/24/2022-12:10:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6622064180404051845
[11/24/2022-12:10:21] [V] [TRT] *************** Autotuning format combination: Float(36960,1,3360,160) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:21] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0365063
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:21] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0350702
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:21] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0389234
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:21] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0349559
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:21] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0432069
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:21] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0432069
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:21] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0390834
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:21] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0359486
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0372446
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:21] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0349449
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:21] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0369886
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:21] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0350574
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:21] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0387497
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:21] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0354734
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:21] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0430629
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:21] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0350299
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:21] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0352558
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0348754
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:21] [V] [TRT] Tactic: -504296718212024303 Time: 0.0347054
[11/24/2022-12:10:21] [V] [TRT] Fastest Tactic: -504296718212024303 Time: 0.0347054
[11/24/2022-12:10:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -504296718212024303
[11/24/2022-12:10:21] [V] [TRT] *************** Autotuning format combination: Float(9240,1:4,840,40) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:21] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0159599
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:21] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0158245
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:21] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0180143
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:21] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0256556
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:21] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0201137
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:21] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0156105
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6031243482516294286 Time: 0.015712
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6419443404913215692 Time: 0.020448
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0208157
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:21] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0184783
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:21] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0221773
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:21] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0369177
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:21] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0159355
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:21] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0265387
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:21] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0219154
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:21] [V] [TRT] Tactic: -5033173285090644307 Time: 0.018204
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:21] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0155936
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0220878
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0397383
[11/24/2022-12:10:21] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:21] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0206243
[11/24/2022-12:10:21] [V] [TRT] Fastest Tactic: -5010594849215755610 Time: 0.0155936
[11/24/2022-12:10:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5010594849215755610
[11/24/2022-12:10:21] [V] [TRT] *************** Autotuning format combination: Half(36960,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:21] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudnnConvolution)
[11/24/2022-12:10:21] [V] [TRT] Tactic: 0 Time: 0.0766971
[11/24/2022-12:10:21] [V] [TRT] Tactic: 1 Time: 0.0773531
[11/24/2022-12:10:21] [V] [TRT] Tactic: 2 Time: 0.122795
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4 Time: 10.7324
[11/24/2022-12:10:22] [V] [TRT] Tactic: 5 Time: 0.695598
[11/24/2022-12:10:22] [V] [TRT] Tactic: 56 Time: 0.0739383
[11/24/2022-12:10:22] [V] [TRT] Tactic: 58 Time: 0.118039
[11/24/2022-12:10:22] [V] [TRT] Tactic: 60 Time: 8.48451
[11/24/2022-12:10:22] [V] [TRT] Tactic: 61 Time: 0.68928
[11/24/2022-12:10:22] [V] [TRT] Fastest Tactic: 56 Time: 0.0739383
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:10:22] [V] [TRT] *************** Autotuning format combination: Half(18480,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] *************** Autotuning format combination: Half(18480,231:2,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (FusedConvActConvolution)
[11/24/2022-12:10:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] *************** Autotuning format combination: Half(4620,1:8,420,20) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] *************** Autotuning format combination: Half(4620,1:8,420,20) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudaDepthwiseConvolution)
[11/24/2022-12:10:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:22] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:22] [V] [TRT] Tactic: 254850674756030979 Time: 0.0158016
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0157646
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0118709
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0138718
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0136291
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0158776
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0158437
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0135555
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0116765
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:22] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0179697
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:22] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0135252
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:22] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0117317
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:22] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0136839
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:22] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0241608
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:22] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0135206
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:22] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0190617
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:22] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0134255
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:22] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0116554
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:22] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0175345
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:22] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0137729
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:22] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0136503
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0155854
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0118305
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0114978
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0136519
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0100343
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0133087
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4571819373777460444 Time: 0.015966
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0137305
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0136669
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:22] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0113076
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:22] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0157143
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:22] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0157906
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:22] [V] [TRT] Tactic: 5205510332404400949 Time: 0.011636
[11/24/2022-12:10:22] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:22] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0115991
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0137351
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0131441
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0156453
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0116902
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0172881
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0114096
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0116687
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0179183
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0138061
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0125337
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0120004
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8101703987960976805 Time: 0.01814
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0159827
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0137916
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0115042
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0136702
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:23] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0135975
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:23] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0138028
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0223269
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0156197
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0137268
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0116986
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0225411
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0115636
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0203217
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0106609
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0247558
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0157751
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0118446
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0137255
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0134209
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5161596964442251102 Time: 0.013718
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0133211
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0158505
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0138431
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0160528
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0179863
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0131844
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0168924
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0160625
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0155685
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0160919
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0139466
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3903342530518878192 Time: 0.013174
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0136607
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0178749
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0115548
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0155909
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0137579
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0111993
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0114954
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2353603993968373338 Time: 0.013696
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0158832
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0121223
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1985778916402815946 Time: 0.013777
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0182434
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0135244
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0105646
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0141124
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0222903
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0153938
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:23] [V] [TRT] Tactic: -406984317033388136 Time: 0.0137829
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:23] [V] [TRT] Tactic: -331499326992534460 Time: 0.0118734
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:23] [V] [TRT] Tactic: -206523504474952360 Time: 0.0114261
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: 4528997467275241200 Time: 0.0100343
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4528997467275241200
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Half(2310,1:16,210,10) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Half(1155,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CublasConvolution)
[11/24/2022-12:10:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudaDepthwiseConvolution)
[11/24/2022-12:10:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:23] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0202183
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2141154648944475104 Time: 0.020344
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3239257003214966313 Time: 0.020256
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0202183
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0202846
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0203246
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0206282
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0202131
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0204415
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0204029
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:23] [V] [TRT] Tactic: -108011214168778087 Time: 0.0203503
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:23] [V] [TRT] Tactic: -42427192380281294 Time: 0.0203389
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: -4443833619060044580 Time: 0.0202131
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4443833619060044580
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudaDepthwiseConvolution)
[11/24/2022-12:10:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (FusedConvActConvolution)
[11/24/2022-12:10:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:23] [V] [TRT] Tactic: 175853789719975416 Time: 0.0182394
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0180166
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2234457234705232274 Time: 0.017916
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0180149
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0172516
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6341572697076960911 Time: 0.017952
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0179474
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0162108
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7303593854972602201 Time: 0.017988
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0173917
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3326139578711341011 Time: 0.018428
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:23] [V] [TRT] Tactic: -683636008127039856 Time: 0.0179131
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0162108
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:23] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0181286
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2855900226702061782 Time: 0.017968
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0179486
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:23] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0179994
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0178022
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0178634
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0179509
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4255737803793506479 Time: 0.018008
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0180709
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0180771
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0181011
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:23] [V] [TRT] Tactic: -868495160148524802 Time: 0.0179491
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0178022
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0207308
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0201771
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0207582
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: 5104832031493112835 Time: 0.0201771
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5104832031493112835
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Float(6930,231:32,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0153234
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0149285
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0149938
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:23] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0155049
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0179937
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0154258
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0153678
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0187457
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0150304
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0154363
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0150395
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0151579
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0152347
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0152411
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0178606
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0153957
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0181463
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0179223
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0154208
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0153883
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7282232519526877434 Time: 0.018068
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0149719
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0152645
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0156059
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0153659
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0152142
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0179623
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3644377136375731441 Time: 0.015445
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0152375
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0153408
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0163616
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:23] [V] [TRT] Tactic: -621838502160440068 Time: 0.0159858
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0149285
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:23] [V] [TRT] Tactic: 424230345342282109 Time: 0.0128884
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00971459
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0124023
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0119135
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:23] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0153609
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0124354
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0123539
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0125025
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0100931
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7515859573761964679 Time: 0.015269
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0100389
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00980876
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00990354
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0148599
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00976213
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:23] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0126042
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00969813
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0123044
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0119261
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0127977
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0126983
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6183300053070809929 Time: 0.012136
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0122587
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5817829912551792981 Time: 0.012581
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0125562
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0101163
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0124141
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0123669
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0151063
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0152942
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0126838
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:23] [V] [TRT] Tactic: -50323486981480818 Time: 0.012549
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: -8897233019398469012 Time: 0.00969813
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8897233019398469012
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudaGroupConvolution)
[11/24/2022-12:10:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CudaDepthwiseConvolution)
[11/24/2022-12:10:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (FusedConvActConvolution)
[11/24/2022-12:10:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_631 + node_of_632 + PWN(node_of_633) (CaskConvolution)
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:23] [V] [TRT] Tactic: 125145153013230687 Time: 0.0101224
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:23] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0116951
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:23] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0119451
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:23] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0125337
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00959939
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0122377
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0119676
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:23] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0124217
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:23] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0150231
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:23] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00953966
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:23] [V] [TRT] Tactic: 4796956614760326119 Time: 0.011091
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00988099
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0101723
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00931971
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:23] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0100264
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0117204
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6405251167055673379 Time: 0.011833
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6433368103202497147 Time: 0.00972404
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0124465
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0100562
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0097283
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00931714
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0096387
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:23] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0096192
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:23] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0119539
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8142283985160822229 Time: 0.01196
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0121154
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0121825
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0100047
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:23] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0114483
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:23] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0119349
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:23] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0123215
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0105228
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6510232214299595844 Time: 0.012416
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:23] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0153563
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0115386
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0101626
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:23] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0118868
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4455415102719506646 Time: 0.011911
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0122728
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0117848
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:23] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0105443
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0122004
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0149847
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:23] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0100681
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0119097
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0119657
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:23] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0121459
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1916483171117495388 Time: 0.00949286
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0155136
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0110495
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0125524
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:23] [V] [TRT] Tactic: -405554772060757402 Time: 0.0100864
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:23] [V] [TRT] Tactic: -375949437730908730 Time: 0.00993524
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:23] [V] [TRT] Tactic: -111878368089469751 Time: 0.0122354
[11/24/2022-12:10:23] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:23] [V] [TRT] Tactic: -19707840769375107 Time: 0.0102309
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: 6793988781414507278 Time: 0.00931714
[11/24/2022-12:10:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6793988781414507278
[11/24/2022-12:10:23] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:23] [V] [TRT] *************** Autotuning format combination: Float(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudaDepthwiseConvolution)
[11/24/2022-12:10:23] [V] [TRT] Tactic: -1 Time: 0.0259893
[11/24/2022-12:10:23] [V] [TRT] Fastest Tactic: -1 Time: 0.0259893
[11/24/2022-12:10:23] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudnnConvolution)
[11/24/2022-12:10:23] [V] [TRT] Tactic: 0 Time: 0.0511741
[11/24/2022-12:10:23] [V] [TRT] Tactic: 1 Time: 0.0511375
[11/24/2022-12:10:23] [V] [TRT] Tactic: 2 Time: 0.050141
[11/24/2022-12:10:24] [V] [TRT] Tactic: 4 Time: 22.3938
[11/24/2022-12:10:24] [V] [TRT] Tactic: 5 Time: 32.9767
[11/24/2022-12:10:24] [V] [TRT] Tactic: 6 Time: 5.27963
[11/24/2022-12:10:24] [V] [TRT] Tactic: 56 Time: 0.0502339
[11/24/2022-12:10:24] [V] [TRT] Tactic: 57 Time: 0.0501928
[11/24/2022-12:10:24] [V] [TRT] Tactic: 58 Time: 0.0505661
[11/24/2022-12:10:24] [V] [TRT] Tactic: 60 Time: 22.5587
[11/24/2022-12:10:24] [V] [TRT] Tactic: 61 Time: 32.8563
[11/24/2022-12:10:24] [V] [TRT] Tactic: 62 Time: 5.28969
[11/24/2022-12:10:24] [V] [TRT] Tactic: 112 Time: 0.0504579
[11/24/2022-12:10:24] [V] [TRT] Tactic: 113 Time: 0.0505021
[11/24/2022-12:10:24] [V] [TRT] Tactic: 114 Time: 0.0505006
[11/24/2022-12:10:25] [V] [TRT] Tactic: 116 Time: 22.2246
[11/24/2022-12:10:25] [V] [TRT] Tactic: 117 Time: 32.9647
[11/24/2022-12:10:25] [V] [TRT] Tactic: 118 Time: 5.29665
[11/24/2022-12:10:25] [V] [TRT] Fastest Tactic: 2 Time: 0.050141
[11/24/2022-12:10:25] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:25] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:10:25] [V] [TRT] Tactic: 130477820174479366 Time: 11.5299
[11/24/2022-12:10:25] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:10:25] [V] [TRT] Tactic: 1358952225285826925 Time: 12.1922
[11/24/2022-12:10:25] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:25] [V] [TRT] Tactic: 4549827808004681195 Time: 11.495
[11/24/2022-12:10:25] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:10:25] [V] [TRT] Tactic: 5127140674766136213 Time: 7.92669
[11/24/2022-12:10:25] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:10:25] [V] [TRT] Tactic: 5691674214365884252 Time: 22.4434
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:26] [V] [TRT] Tactic: 5779835512569528575 Time: 12.8863
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:10:26] [V] [TRT] Tactic: 6053873026024413720 Time: 13.2851
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:10:26] [V] [TRT] Tactic: 6532229230713743445 Time: 11.58
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:10:26] [V] [TRT] Tactic: 6767548733843469815 Time: 11.8317
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:10:26] [V] [TRT] Tactic: -7777264329408437990 Time: 9.7536
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:10:26] [V] [TRT] Tactic: -6693149634808211969 Time: 7.99453
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:26] [V] [TRT] Tactic: -6313876406580483184 Time: 10.8867
[11/24/2022-12:10:26] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:10:27] [V] [TRT] Tactic: -4932505327461806800 Time: 23.2625
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:10:27] [V] [TRT] Tactic: -2870780723387717246 Time: 9.02858
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:27] [V] [TRT] Tactic: -1123676555321336786 Time: 13.3448
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:27] [V] [TRT] Tactic: -701551393537224327 Time: 11.8538
[11/24/2022-12:10:27] [V] [TRT] Fastest Tactic: 5127140674766136213 Time: 7.92669
[11/24/2022-12:10:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1
[11/24/2022-12:10:27] [V] [TRT] *************** Autotuning format combination: Float(221760,1,20160,960) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:10:27] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:10:27] [V] [TRT] Tactic: 1852818056038333088 Time: 11.028
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:10:27] [V] [TRT] Tactic: 2137271960938803767 Time: 15.3883
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:10:27] [V] [TRT] Tactic: 4543151729465212056 Time: 26.2646
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110002
[11/24/2022-12:10:27] [V] [TRT] Tactic: 5778138195697110002 Time: 1.60105
[11/24/2022-12:10:27] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:10:28] [V] [TRT] Tactic: 7098622778606028509 Time: 11.0107
[11/24/2022-12:10:28] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:10:28] [V] [TRT] Tactic: -9217704540809507511 Time: 25.7595
[11/24/2022-12:10:28] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:10:28] [V] [TRT] Tactic: -7734972403155710907 Time: 10.9068
[11/24/2022-12:10:28] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507463
[11/24/2022-12:10:28] [V] [TRT] Tactic: -3855385237722507463 Time: 1.63242
[11/24/2022-12:10:28] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:10:28] [V] [TRT] Tactic: -3360299822783115645 Time: 14.6777
[11/24/2022-12:10:28] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049392
[11/24/2022-12:10:28] [V] [TRT] Tactic: -2809379259463049392 Time: 1.6135
[11/24/2022-12:10:28] [V] [TRT] node_of_634 + node_of_635 + PWN(node_of_636) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:10:28] [V] [TRT] Tactic: -824800713406371346 Time: 15.2513
[11/24/2022-12:10:28] [V] [TRT] Fastest Tactic: 5778138195697110002 Time: 1.60105
[11/24/2022-12:10:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5778138195697110002
[11/24/2022-12:10:28] [V] [TRT] *************** Autotuning format combination: Float(55440,1:4,5040,240) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:10:28] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:28] [V] [TRT] *************** Autotuning format combination: Half(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:28] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudnnConvolution)
[11/24/2022-12:10:28] [V] [TRT] Tactic: 0 Time: 0.0434651
[11/24/2022-12:10:28] [V] [TRT] Tactic: 1 Time: 0.0420846
[11/24/2022-12:10:28] [V] [TRT] Tactic: 2 Time: 0.0506712
[11/24/2022-12:10:28] [V] [TRT] Tactic: 4 Time: 22.9865
[11/24/2022-12:10:29] [V] [TRT] Tactic: 5 Time: 33.2198
[11/24/2022-12:10:29] [V] [TRT] Tactic: 6 Time: 26.6292
[11/24/2022-12:10:29] [V] [TRT] Tactic: 56 Time: 0.040504
[11/24/2022-12:10:29] [V] [TRT] Tactic: 58 Time: 0.0501394
[11/24/2022-12:10:29] [V] [TRT] Tactic: 60 Time: 22.6667
[11/24/2022-12:10:29] [V] [TRT] Tactic: 61 Time: 32.8845
[11/24/2022-12:10:30] [V] [TRT] Tactic: 62 Time: 25.9583
[11/24/2022-12:10:30] [V] [TRT] Fastest Tactic: 56 Time: 0.040504
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudaDepthwiseConvolution)
[11/24/2022-12:10:30] [V] [TRT] Tactic: -2 Time: 0.0151419
[11/24/2022-12:10:30] [V] [TRT] Fastest Tactic: -2 Time: 0.0151419
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -2
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Half(13860,1:16,1260,60) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Half(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudaDepthwiseConvolution)
[11/24/2022-12:10:30] [V] [TRT] Tactic: -5 Time: 0.0587901
[11/24/2022-12:10:30] [V] [TRT] Fastest Tactic: -5 Time: 0.0587901
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -5
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudaDepthwiseConvolution)
[11/24/2022-12:10:30] [V] [TRT] Tactic: -3 Time: 0.010066
[11/24/2022-12:10:30] [V] [TRT] Fastest Tactic: -3 Time: 0.010066
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -3
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(6930,231:32,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudaGroupConvolution)
[11/24/2022-12:10:30] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CudaDepthwiseConvolution)
[11/24/2022-12:10:30] [V] [TRT] Tactic: -4 Time: 0.00974964
[11/24/2022-12:10:30] [V] [TRT] Tactic: 0 Time: 0.0120069
[11/24/2022-12:10:30] [V] [TRT] Tactic: 1 Time: 0.0123158
[11/24/2022-12:10:30] [V] [TRT] Tactic: 2 Time: 0.012488
[11/24/2022-12:10:30] [V] [TRT] Tactic: 3 Time: 0.0122789
[11/24/2022-12:10:30] [V] [TRT] Tactic: 4 Time: 0.0149157
[11/24/2022-12:10:30] [V] [TRT] Tactic: 5 Time: 0.0126343
[11/24/2022-12:10:30] [V] [TRT] Tactic: 6 Time: 0.0205773
[11/24/2022-12:10:30] [V] [TRT] Tactic: 7 Time: 0.01854
[11/24/2022-12:10:30] [V] [TRT] Tactic: 8 Time: 0.0332736
[11/24/2022-12:10:30] [V] [TRT] Tactic: 9 Time: 0.0312265
[11/24/2022-12:10:30] [V] [TRT] Tactic: 10 Time: 0.0104934
[11/24/2022-12:10:30] [V] [TRT] Tactic: 11 Time: 0.0120777
[11/24/2022-12:10:30] [V] [TRT] Tactic: 12 Time: 0.0123524
[11/24/2022-12:10:30] [V] [TRT] Tactic: 13 Time: 0.0124522
[11/24/2022-12:10:30] [V] [TRT] Tactic: 14 Time: 0.0148773
[11/24/2022-12:10:30] [V] [TRT] Tactic: 15 Time: 0.0125314
[11/24/2022-12:10:30] [V] [TRT] Tactic: 16 Time: 0.020527
[11/24/2022-12:10:30] [V] [TRT] Tactic: 17 Time: 0.0182766
[11/24/2022-12:10:30] [V] [TRT] Tactic: 18 Time: 0.0315995
[11/24/2022-12:10:30] [V] [TRT] Tactic: 19 Time: 0.0311744
[11/24/2022-12:10:30] [V] [TRT] Tactic: 20 Time: 0.0150638
[11/24/2022-12:10:30] [V] [TRT] Tactic: 21 Time: 0.0107827
[11/24/2022-12:10:30] [V] [TRT] Tactic: 22 Time: 0.0176843
[11/24/2022-12:10:30] [V] [TRT] Tactic: 23 Time: 0.0124331
[11/24/2022-12:10:30] [V] [TRT] Tactic: 24 Time: 0.0178184
[11/24/2022-12:10:30] [V] [TRT] Tactic: 25 Time: 0.012515
[11/24/2022-12:10:30] [V] [TRT] Tactic: 26 Time: 0.0282712
[11/24/2022-12:10:30] [V] [TRT] Tactic: 27 Time: 0.0180223
[11/24/2022-12:10:30] [V] [TRT] Tactic: 28 Time: 0.0475143
[11/24/2022-12:10:30] [V] [TRT] Tactic: 29 Time: 0.030048
[11/24/2022-12:10:30] [V] [TRT] Tactic: 30 Time: 0.0103344
[11/24/2022-12:10:30] [V] [TRT] Tactic: 31 Time: 0.0121992
[11/24/2022-12:10:30] [V] [TRT] Tactic: 32 Time: 0.0125349
[11/24/2022-12:10:30] [V] [TRT] Tactic: 33 Time: 0.0118045
[11/24/2022-12:10:30] [V] [TRT] Tactic: 34 Time: 0.0148453
[11/24/2022-12:10:30] [V] [TRT] Tactic: 35 Time: 0.0124629
[11/24/2022-12:10:30] [V] [TRT] Tactic: 36 Time: 0.0206446
[11/24/2022-12:10:30] [V] [TRT] Tactic: 37 Time: 0.0177661
[11/24/2022-12:10:30] [V] [TRT] Tactic: 38 Time: 0.0315026
[11/24/2022-12:10:30] [V] [TRT] Tactic: 39 Time: 0.0261684
[11/24/2022-12:10:30] [V] [TRT] Tactic: 40 Time: 0.0100114
[11/24/2022-12:10:30] [V] [TRT] Tactic: 41 Time: 0.0101623
[11/24/2022-12:10:30] [V] [TRT] Tactic: 42 Time: 0.012259
[11/24/2022-12:10:30] [V] [TRT] Tactic: 43 Time: 0.0123021
[11/24/2022-12:10:30] [V] [TRT] Tactic: 44 Time: 0.0146629
[11/24/2022-12:10:30] [V] [TRT] Tactic: 45 Time: 0.0123006
[11/24/2022-12:10:30] [V] [TRT] Tactic: 46 Time: 0.0205329
[11/24/2022-12:10:30] [V] [TRT] Tactic: 47 Time: 0.0179497
[11/24/2022-12:10:30] [V] [TRT] Tactic: 48 Time: 0.0313198
[11/24/2022-12:10:30] [V] [TRT] Tactic: 49 Time: 0.0261112
[11/24/2022-12:10:30] [V] [TRT] Tactic: 50 Time: 0.0127166
[11/24/2022-12:10:30] [V] [TRT] Tactic: 51 Time: 0.00998339
[11/24/2022-12:10:30] [V] [TRT] Tactic: 52 Time: 0.0153614
[11/24/2022-12:10:30] [V] [TRT] Tactic: 53 Time: 0.0122945
[11/24/2022-12:10:30] [V] [TRT] Tactic: 54 Time: 0.0159751
[11/24/2022-12:10:30] [V] [TRT] Tactic: 55 Time: 0.0123189
[11/24/2022-12:10:30] [V] [TRT] Tactic: 56 Time: 0.0253874
[11/24/2022-12:10:30] [V] [TRT] Tactic: 57 Time: 0.0178265
[11/24/2022-12:10:30] [V] [TRT] Tactic: 58 Time: 0.0421897
[11/24/2022-12:10:30] [V] [TRT] Tactic: 59 Time: 0.0260648
[11/24/2022-12:10:30] [V] [TRT] Fastest Tactic: -4 Time: 0.00974964
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_634 + node_of_635 + PWN(node_of_636) (CaskConvolution)
[11/24/2022-12:10:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -4
[11/24/2022-12:10:30] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:30] [V] [TRT] *************** Autotuning format combination: Float(221760,231,21,1), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudaDepthwiseConvolution)
[11/24/2022-12:10:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (FusedConvActConvolution)
[11/24/2022-12:10:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:30] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudnnConvolution)
[11/24/2022-12:10:30] [V] [TRT] Tactic: 0 Time: 0.0915063
[11/24/2022-12:10:30] [V] [TRT] Tactic: 1 Time: 0.121223
[11/24/2022-12:10:30] [V] [TRT] Tactic: 2 Time: 0.162277
[11/24/2022-12:10:30] [V] [TRT] Tactic: 4 Time: 12.0683
[11/24/2022-12:10:30] [V] [TRT] Tactic: 5 Time: 1.10999
[11/24/2022-12:10:30] [V] [TRT] Tactic: 56 Time: 0.09016
[11/24/2022-12:10:30] [V] [TRT] Tactic: 57 Time: 0.111605
[11/24/2022-12:10:30] [V] [TRT] Tactic: 58 Time: 0.160142
[11/24/2022-12:10:31] [V] [TRT] Tactic: 60 Time: 12.055
[11/24/2022-12:10:31] [V] [TRT] Tactic: 61 Time: 1.10963
[11/24/2022-12:10:31] [V] [TRT] Tactic: 112 Time: 0.0909897
[11/24/2022-12:10:31] [V] [TRT] Tactic: 113 Time: 0.086816
[11/24/2022-12:10:31] [V] [TRT] Tactic: 114 Time: 0.160581
[11/24/2022-12:10:31] [V] [TRT] Tactic: 116 Time: 11.7259
[11/24/2022-12:10:31] [V] [TRT] Tactic: 117 Time: 0.978565
[11/24/2022-12:10:31] [V] [TRT] Fastest Tactic: 113 Time: 0.086816
[11/24/2022-12:10:31] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:31] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:10:31] [V] [TRT] Tactic: 621442388677115936 Time: 0.0379166
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:10:31] [V] [TRT] Tactic: 697756878388249475 Time: 0.0434914
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:10:31] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0454114
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:10:31] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0455851
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:10:31] [V] [TRT] Tactic: 2290218393647758202 Time: 0.06224
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:10:31] [V] [TRT] Tactic: 2310520233542099555 Time: 0.100798
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:10:31] [V] [TRT] Tactic: 3377996665278764661 Time: 0.192681
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:10:31] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0475109
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:31] [V] [TRT] Tactic: 4549827808004681195 Time: 0.122926
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:10:31] [V] [TRT] Tactic: 4918658762935651592 Time: 0.060349
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:31] [V] [TRT] Tactic: 5779835512569528575 Time: 0.158894
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:10:31] [V] [TRT] Tactic: 5837905844602864231 Time: 0.115237
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:10:31] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0825394
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:10:31] [V] [TRT] Tactic: 6210049212073459059 Time: 0.076384
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:10:31] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0539383
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:10:31] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0746263
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:10:31] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0372503
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:10:31] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0289819
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:10:31] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0815703
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:10:31] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0723451
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:10:31] [V] [TRT] Tactic: -8877086111929938764 Time: 0.113744
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:10:31] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0596556
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:10:31] [V] [TRT] Tactic: -8198656951359619379 Time: 0.098784
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:10:31] [V] [TRT] Tactic: -7491730084094677098 Time: 0.14805
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:10:31] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0930011
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:10:31] [V] [TRT] Tactic: -7070045993088702524 Time: 0.190683
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:10:31] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0726423
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:31] [V] [TRT] Tactic: -6313876406580483184 Time: 0.154057
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:10:31] [V] [TRT] Tactic: -6273689210331812572 Time: 0.158203
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:10:31] [V] [TRT] Tactic: -4562045946847239058 Time: 0.096192
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:10:31] [V] [TRT] Tactic: -4337126844824617177 Time: 0.118334
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:10:31] [V] [TRT] Tactic: -2777237991111865351 Time: 0.102005
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:10:31] [V] [TRT] Tactic: -1918478037390720253 Time: 0.100261
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:10:31] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0315758
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:31] [V] [TRT] Tactic: -1123676555321336786 Time: 0.164041
[11/24/2022-12:10:31] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:32] [V] [TRT] Tactic: -701551393537224327 Time: 0.131369
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:10:32] [V] [TRT] Tactic: -3258434593395023 Time: 0.332654
[11/24/2022-12:10:32] [V] [TRT] Fastest Tactic: 6901214267543238617 Time: 0.0289819
[11/24/2022-12:10:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6901214267543238617
[11/24/2022-12:10:32] [V] [TRT] *************** Autotuning format combination: Float(221760,1,20160,960), Float(36960,1,3360,160) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:10:32] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:32] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:32] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0847566
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:32] [V] [TRT] Tactic: 1663866669559596164 Time: 0.163963
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:32] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0968
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:32] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0850949
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:32] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0556754
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:32] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0574568
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:32] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0991497
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:32] [V] [TRT] Tactic: 5778138195697110003 Time: 0.164489
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:32] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0531779
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:32] [V] [TRT] Tactic: 8918020581761223752 Time: 0.155822
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:32] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0531048
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:32] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0859497
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:32] [V] [TRT] Tactic: -4896615592193611463 Time: 0.157134
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:32] [V] [TRT] Tactic: -4056705536979434560 Time: 0.083824
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:32] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0537859
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:32] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0833554
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:32] [V] [TRT] Tactic: -2809379259463049391 Time: 0.162034
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:32] [V] [TRT] Tactic: -1985235291706575900 Time: 0.156315
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:32] [V] [TRT] Tactic: -504296718212024303 Time: 0.153426
[11/24/2022-12:10:32] [V] [TRT] Fastest Tactic: -8031737312007363273 Time: 0.0531048
[11/24/2022-12:10:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8031737312007363273
[11/24/2022-12:10:32] [V] [TRT] *************** Autotuning format combination: Float(55440,1:4,5040,240), Float(9240,1:4,840,40) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:10:32] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:32] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:32] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0512533
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:32] [V] [TRT] Tactic: 2536540085349545921 Time: 0.042088
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:32] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0272762
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:32] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0203371
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:32] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0262187
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:32] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0399623
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:32] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0373223
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:32] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0636937
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:32] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0626286
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:32] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0287488
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:32] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0276206
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:32] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0288704
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:32] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0505341
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:32] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0206642
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:32] [V] [TRT] Tactic: -6073218138311523634 Time: 0.064128
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:32] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0286885
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:32] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0371406
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:32] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0633463
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:32] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0288731
[11/24/2022-12:10:32] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:32] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0286491
[11/24/2022-12:10:32] [V] [TRT] Fastest Tactic: 5108195418077987197 Time: 0.0203371
[11/24/2022-12:10:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5108195418077987197
[11/24/2022-12:10:32] [V] [TRT] *************** Autotuning format combination: Half(221760,231,21,1), Half(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:10:32] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudnnConvolution)
[11/24/2022-12:10:32] [V] [TRT] Tactic: 0 Time: 0.130969
[11/24/2022-12:10:32] [V] [TRT] Tactic: 1 Time: 0.0941874
[11/24/2022-12:10:32] [V] [TRT] Tactic: 2 Time: 0.241595
[11/24/2022-12:10:32] [V] [TRT] Tactic: 4 Time: 11.5384
[11/24/2022-12:10:32] [V] [TRT] Tactic: 5 Time: 0.94955
[11/24/2022-12:10:32] [V] [TRT] Tactic: 56 Time: 0.127029
[11/24/2022-12:10:32] [V] [TRT] Tactic: 58 Time: 0.236421
[11/24/2022-12:10:33] [V] [TRT] Tactic: 60 Time: 9.41871
[11/24/2022-12:10:33] [V] [TRT] Tactic: 61 Time: 0.949778
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: 1 Time: 0.0941874
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1), Half(18480,231:2,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (FusedConvActConvolution)
[11/24/2022-12:10:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120), Half(4620,1:8,420,20) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudaDepthwiseConvolution)
[11/24/2022-12:10:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:33] [V] [TRT] Tactic: 254850674756030979 Time: 0.0370674
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1016009564074305832 Time: 0.036152
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0221551
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0368834
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0371989
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1576319725282257846 Time: 0.016032
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0160874
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0159111
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0208829
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0134845
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0159457
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0244389
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0337499
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0136823
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0161158
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0136902
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0183326
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0225025
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0433074
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0348763
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0115727
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0158501
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0181817
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0179166
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0346715
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4528997467275241200 Time: 0.022351
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0239589
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0412057
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4595173549602041350 Time: 0.033269
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0265265
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0178817
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0358903
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5070322914990170527 Time: 0.035499
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0243863
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0222988
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5398999388616959893 Time: 0.027744
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0158162
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0349934
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0225411
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0166395
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0170316
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0220441
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0136856
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0397269
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0160269
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8095507026323593899 Time: 0.022481
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0138996
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0159416
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0279543
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0139557
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0372171
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:33] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0136989
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:33] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0287296
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0139358
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0356955
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0348864
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0142454
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0135111
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0175817
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0131611
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0212604
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0138676
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0160879
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0245432
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0137883
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0234919
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5161596964442251102 Time: 0.016031
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0159142
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0371669
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0117823
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0161935
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0134994
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0160594
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4293222705763522367 Time: 0.013238
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0414183
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0160229
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0161326
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0303835
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0267505
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0286254
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0135975
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0223673
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0350354
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0159837
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0224888
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0225234
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0267619
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0161747
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0158203
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0294885
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0136162
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0159716
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1562548049711204899 Time: 0.02243
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0156965
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0148402
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0177371
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:33] [V] [TRT] Tactic: -406984317033388136 Time: 0.0357223
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:33] [V] [TRT] Tactic: -331499326992534460 Time: 0.0167812
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:33] [V] [TRT] Tactic: -206523504474952360 Time: 0.0232568
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: 3899310434460415852 Time: 0.0115727
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3899310434460415852
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Half(13860,1:16,1260,60), Half(2310,1:16,210,10) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Half(6930,231:32,21,1), Half(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CublasConvolution)
[11/24/2022-12:10:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudaDepthwiseConvolution)
[11/24/2022-12:10:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0640244
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0620952
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0637958
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0412343
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0421737
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6580271968881459581 Time: 0.047408
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0423029
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0397966
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0509333
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0450206
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:33] [V] [TRT] Tactic: -108011214168778087 Time: 0.0477425
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:33] [V] [TRT] Tactic: -42427192380281294 Time: 0.0397371
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: -42427192380281294 Time: 0.0397371
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -42427192380281294
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1), Int8(9240,231:4,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudaDepthwiseConvolution)
[11/24/2022-12:10:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (FusedConvActConvolution)
[11/24/2022-12:10:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:33] [V] [TRT] Tactic: 175853789719975416 Time: 0.0499947
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0424766
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0394343
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0400434
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6299962968199310600 Time: 0.058941
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0381634
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8626990807754934295 Time: 0.046088
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0370983
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0393429
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0603535
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3326139578711341011 Time: 0.04516
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:33] [V] [TRT] Tactic: -683636008127039856 Time: 0.0608244
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0370983
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1), Int8(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0452366
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0591589
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0399691
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4325765560739862899 Time: 0.061152
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0370137
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0450126
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0373771
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0607619
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0389909
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0422914
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0488747
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:33] [V] [TRT] Tactic: -868495160148524802 Time: 0.0395909
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0370137
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0124888
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0154139
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0125147
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0124888
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Float(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0176488
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0124038
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0100407
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0242971
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5012796702462679112 Time: 0.042328
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0261928
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0118748
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0252229
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0116557
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0118185
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0124179
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0122453
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0124438
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8893439100868426414 Time: 0.017728
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0284274
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0259436
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0250324
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0421714
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0099971
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0257714
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0422069
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0100846
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6406011580107094428 Time: 0.010304
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0261097
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0261638
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:33] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0175939
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0286994
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0260472
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0119726
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0177209
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0260754
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:33] [V] [TRT] Tactic: -621838502160440068 Time: 0.0264038
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: -7633993163187901093 Time: 0.0099971
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7633993163187901093
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Half(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:33] [V] [TRT] Tactic: 424230345342282109 Time: 0.0261455
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0151589
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0260145
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0100322
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0370217
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0105022
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7107586691882206281 Time: 0.023426
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0252122
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0154107
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0370617
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0120084
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0118889
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0153371
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0112788
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0120789
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:33] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0102504
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0150953
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00995109
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00994316
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:33] [V] [TRT] Tactic: -7272221766465547628 Time: 0.026112
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0260571
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0233927
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:33] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0232411
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0237642
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:33] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0100794
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0122244
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0261371
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:33] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0235298
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:33] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0119242
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0370354
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:33] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0246187
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:33] [V] [TRT] Tactic: -50323486981480818 Time: 0.026016
[11/24/2022-12:10:33] [V] [TRT] Fastest Tactic: -8206171403568243244 Time: 0.00994316
[11/24/2022-12:10:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8206171403568243244
[11/24/2022-12:10:33] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Int8(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudaGroupConvolution)
[11/24/2022-12:10:33] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CudaDepthwiseConvolution)
[11/24/2022-12:10:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (FusedConvActConvolution)
[11/24/2022-12:10:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:33] [V] [TRT] --------------- Timing Runner: node_of_637 + node_of_638 + node_of_639 (CaskConvolution)
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:33] [V] [TRT] Tactic: 125145153013230687 Time: 0.0181406
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1583811548148740665 Time: 0.012803
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0126693
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:33] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0100657
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:33] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0120651
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0100568
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0101196
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:33] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0108813
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0115021
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0121604
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:33] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0126933
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0114852
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0125634
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0152329
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:33] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0118516
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0200697
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6405251167055673379 Time: 0.012853
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0154341
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0114609
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0182434
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0121261
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0152718
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0153929
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:33] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0167375
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:33] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0132679
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0234671
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0231399
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8234775147403903473 Time: 0.02339
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0126469
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:33] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0128046
[11/24/2022-12:10:33] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:33] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0119775
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:34] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00999436
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:34] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0125189
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:34] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0100489
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:34] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0182423
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:34] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0122354
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:34] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0180617
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:34] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0116832
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:34] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00975512
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:34] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0260419
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:34] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0124884
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:34] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0182194
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:34] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00978408
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:34] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0117408
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:34] [V] [TRT] Tactic: -3288585994448820820 Time: 0.01798
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:34] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0123398
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:34] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0128103
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:34] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0232385
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:34] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0154587
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:34] [V] [TRT] Tactic: -1549742793039499659 Time: 0.018172
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:34] [V] [TRT] Tactic: -1328736756812546664 Time: 0.011821
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:34] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0098685
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:34] [V] [TRT] Tactic: -405554772060757402 Time: 0.0118319
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:34] [V] [TRT] Tactic: -375949437730908730 Time: 0.0121109
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:34] [V] [TRT] Tactic: -111878368089469751 Time: 0.0259733
[11/24/2022-12:10:34] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:34] [V] [TRT] Tactic: -19707840769375107 Time: 0.0121813
[11/24/2022-12:10:34] [V] [TRT] Fastest Tactic: -4455415102719506646 Time: 0.00975512
[11/24/2022-12:10:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4455415102719506646
[11/24/2022-12:10:34] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(36960,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(36960,1,3360,160) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(9240,1:4,840,40) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(36960,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(18480,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(18480,231:2,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(4620,1:8,420,20) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(4620,1:8,420,20) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(2310,1:16,210,10) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(1155,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Float(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,1,20160,960) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(55440,1:4,5040,240) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(13860,1:16,1260,60) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,231,21,1), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,1,20160,960), Float(36960,1,3360,160) -> Float(36960,1,3360,160) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(55440,1:4,5040,240), Float(9240,1:4,840,40) -> Float(9240,1:4,840,40) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(221760,231,21,1), Half(36960,231,21,1) -> Half(36960,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1), Half(18480,231:2,21,1) -> Half(18480,231:2,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120), Half(4620,1:8,420,20) -> Half(4620,1:8,420,20) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(13860,1:16,1260,60), Half(2310,1:16,210,10) -> Half(2310,1:16,210,10) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(6930,231:32,21,1), Half(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1), Int8(9240,231:4,21,1) -> Int8(9240,231:4,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1), Int8(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Float(36960,231,21,1) -> Float(36960,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Float(1155,231:32,21,1) -> Float(1155,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Half(1155,231:32,21,1) -> Half(1155,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1), Int8(1155,231:32,21,1) -> Int8(1155,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(36960,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(36960,1,3360,160) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(9240,1:4,840,40) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(36960,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(18480,231:2,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(18480,231:2,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(4620,1:8,420,20) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(4620,1:8,420,20) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(2310,1:16,210,10) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(1155,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(9240,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Float(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(1155,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,231,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,1,20160,960) -> Float(221760,1,20160,960) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(55440,1:4,5040,240) -> Float(55440,1:4,5040,240) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(221760,231,21,1) -> Half(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1) -> Half(110880,231:2,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Half(27720,1:8,2520,120) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(13860,1:16,1260,60) -> Half(13860,1:16,1260,60) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Half(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(55440,231:4,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(221760,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Half(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Int8(6930,231:32,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:34] [V] [TRT] *************** Autotuning format combination: Float(221760,231,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:10:34] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudaDepthwiseConvolution)
[11/24/2022-12:10:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:34] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (FusedConvActConvolution)
[11/24/2022-12:10:34] [V] [TRT] Tactic: 589823 Time: 0.281166
[11/24/2022-12:10:34] [V] [TRT] Tactic: 655359 Time: 0.213495
[11/24/2022-12:10:34] [V] [TRT] Tactic: 786431 Time: 0.151502
[11/24/2022-12:10:34] [V] [TRT] Tactic: 851967 Time: 0.115959
[11/24/2022-12:10:34] [V] [TRT] Tactic: 1179647 Time: 0.10173
[11/24/2022-12:10:34] [V] [TRT] Tactic: 1638399 Time: 0.148357
[11/24/2022-12:10:34] [V] [TRT] Tactic: 2097151 Time: 0.104869
[11/24/2022-12:10:34] [V] [TRT] Tactic: 3538943 Time: 0.129563
[11/24/2022-12:10:34] [V] [TRT] Tactic: 3932159 Time: 0.173362
[11/24/2022-12:10:34] [V] [TRT] Tactic: 3997695 Time: 0.147163
[11/24/2022-12:10:34] [V] [TRT] Tactic: 4194303 Time: 0.107257
[11/24/2022-12:10:34] [V] [TRT] Tactic: 4259839 Time: 0.114846
[11/24/2022-12:10:34] [V] [TRT] Tactic: 4587519 Time: 0.126274
[11/24/2022-12:10:34] [V] [TRT] Tactic: 4653055 Time: 0.0942834
[11/24/2022-12:10:34] [V] [TRT] Tactic: 4915199 Time: 0.108384
[11/24/2022-12:10:34] [V] [TRT] Tactic: 4980735 Time: 0.137019
[11/24/2022-12:10:34] [V] [TRT] Tactic: 5177343 Time: 0.103122
[11/24/2022-12:10:34] [V] [TRT] Tactic: 5242879 Time: 0.103362
[11/24/2022-12:10:34] [V] [TRT] Tactic: 5373951 Time: 0.127646
[11/24/2022-12:10:34] [V] [TRT] Tactic: 5570559 Time: 0.123641
[11/24/2022-12:10:34] [V] [TRT] Tactic: 5767167 Time: 0.202245
[11/24/2022-12:10:34] [V] [TRT] Tactic: 5898239 Time: 0.0968411
[11/24/2022-12:10:34] [V] [TRT] Tactic: 6225919 Time: 0.0888297
[11/24/2022-12:10:34] [V] [TRT] Tactic: 6291455 Time: 0.101003
[11/24/2022-12:10:34] [V] [TRT] Tactic: 6815743 Time: 0.120592
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7012351 Time: 0.104549
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7077887 Time: 0.0970126
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7143423 Time: 0.197509
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7208959 Time: 0.117157
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7340031 Time: 0.108014
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7536639 Time: 0.148558
[11/24/2022-12:10:34] [V] [TRT] Tactic: 7733247 Time: 0.104222
[11/24/2022-12:10:34] [V] [TRT] Tactic: 8191999 Time: 0.144224
[11/24/2022-12:10:34] [V] [TRT] Tactic: 8716287 Time: 0.110151
[11/24/2022-12:10:34] [V] [TRT] Tactic: 9109503 Time: 0.136123
[11/24/2022-12:10:34] [V] [TRT] Tactic: 9568255 Time: 0.108553
[11/24/2022-12:10:34] [V] [TRT] Tactic: 10354687 Time: 0.127552
[11/24/2022-12:10:34] [V] [TRT] Tactic: 10747903 Time: 0.0854789
[11/24/2022-12:10:34] [V] [TRT] Fastest Tactic: 10747903 Time: 0.0854789
[11/24/2022-12:10:34] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudnnConvolution)
[11/24/2022-12:10:34] [V] [TRT] Tactic: 0 Time: 0.119022
[11/24/2022-12:10:34] [V] [TRT] Tactic: 1 Time: 0.110565
[11/24/2022-12:10:34] [V] [TRT] Tactic: 2 Time: 0.184507
[11/24/2022-12:10:35] [V] [TRT] Tactic: 4 Time: 22.747
[11/24/2022-12:10:35] [V] [TRT] Tactic: 5 Time: 1.56171
[11/24/2022-12:10:35] [V] [TRT] Tactic: 56 Time: 0.118953
[11/24/2022-12:10:35] [V] [TRT] Tactic: 57 Time: 0.110517
[11/24/2022-12:10:35] [V] [TRT] Tactic: 58 Time: 0.262034
[11/24/2022-12:10:36] [V] [TRT] Tactic: 60 Time: 18.6909
[11/24/2022-12:10:36] [V] [TRT] Tactic: 61 Time: 1.55572
[11/24/2022-12:10:36] [V] [TRT] Tactic: 112 Time: 0.118496
[11/24/2022-12:10:36] [V] [TRT] Tactic: 113 Time: 0.10955
[11/24/2022-12:10:36] [V] [TRT] Tactic: 114 Time: 0.201774
[11/24/2022-12:10:37] [V] [TRT] Tactic: 116 Time: 16.9455
[11/24/2022-12:10:37] [V] [TRT] Tactic: 117 Time: 1.55291
[11/24/2022-12:10:37] [V] [TRT] Fastest Tactic: 113 Time: 0.10955
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:10:37] [V] [TRT] Tactic: 621442388677115936 Time: 0.0370366
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:10:37] [V] [TRT] Tactic: 697756878388249475 Time: 0.0619642
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:10:37] [V] [TRT] Tactic: 1159272950022995759 Time: 0.043464
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:10:37] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0642408
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:10:37] [V] [TRT] Tactic: 2290218393647758202 Time: 0.103415
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:10:37] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0937508
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:10:37] [V] [TRT] Tactic: 3377996665278764661 Time: 0.188357
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:10:37] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0455829
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:37] [V] [TRT] Tactic: 4549827808004681195 Time: 0.122731
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:10:37] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0583558
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:37] [V] [TRT] Tactic: 5779835512569528575 Time: 0.158706
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:10:37] [V] [TRT] Tactic: 5837905844602864231 Time: 0.106736
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0724937
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0749234
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6500866402607985231 Time: 0.051837
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0717486
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6868013466259746979 Time: 0.035008
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0508556
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:10:37] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0730217
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:10:37] [V] [TRT] Tactic: 9151672657204310840 Time: 0.061213
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:10:37] [V] [TRT] Tactic: -8877086111929938764 Time: 0.104389
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:10:37] [V] [TRT] Tactic: -8766093103475083267 Time: 0.103051
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:10:37] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0975291
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:10:37] [V] [TRT] Tactic: -7491730084094677098 Time: 0.147538
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:10:37] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0916846
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:10:37] [V] [TRT] Tactic: -7070045993088702524 Time: 0.18512
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:10:37] [V] [TRT] Tactic: -6622064180404051845 Time: 0.060259
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:37] [V] [TRT] Tactic: -6313876406580483184 Time: 0.154702
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:10:37] [V] [TRT] Tactic: -6273689210331812572 Time: 0.156425
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:10:37] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0935886
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:10:37] [V] [TRT] Tactic: -4337126844824617177 Time: 0.11656
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:10:37] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0927931
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0980503
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0537813
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1123676555321336786 Time: 0.160453
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:37] [V] [TRT] Tactic: -701551393537224327 Time: 0.129045
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:10:37] [V] [TRT] Tactic: -3258434593395023 Time: 0.321024
[11/24/2022-12:10:37] [V] [TRT] Fastest Tactic: 6868013466259746979 Time: 0.035008
[11/24/2022-12:10:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6868013466259746979
[11/24/2022-12:10:37] [V] [TRT] *************** Autotuning format combination: Float(221760,1,20160,960) -> Float(73920,1,6720,320) ***************
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:37] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0817851
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:37] [V] [TRT] Tactic: 1663866669559596164 Time: 0.160283
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:37] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0947566
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:37] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0817211
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:37] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0968754
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:37] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0974011
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:37] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0977349
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:37] [V] [TRT] Tactic: 5778138195697110003 Time: 0.161134
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0870743
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:37] [V] [TRT] Tactic: 8918020581761223752 Time: 0.154295
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:37] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0886446
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:37] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0833394
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:37] [V] [TRT] Tactic: -4896615592193611463 Time: 0.149714
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:37] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0813646
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:37] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0949349
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:37] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0812571
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:37] [V] [TRT] Tactic: -2809379259463049391 Time: 0.159899
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1985235291706575900 Time: 0.153499
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:37] [V] [TRT] Tactic: -504296718212024303 Time: 0.151461
[11/24/2022-12:10:37] [V] [TRT] Fastest Tactic: -3071763921328736248 Time: 0.0812571
[11/24/2022-12:10:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3071763921328736248
[11/24/2022-12:10:37] [V] [TRT] *************** Autotuning format combination: Float(55440,1:4,5040,240) -> Float(18480,1:4,1680,80) ***************
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:37] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0497128
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:37] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0393189
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:37] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0246522
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:37] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0328539
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:37] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0245646
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:37] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0390617
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0353307
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0621181
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0612709
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:37] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0262065
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:37] [V] [TRT] Tactic: 7058864664858220889 Time: 0.025763
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:37] [V] [TRT] Tactic: -8853476220903838035 Time: 0.039256
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:37] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0494507
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:37] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0349477
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:37] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0618926
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:37] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0255413
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:37] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0351552
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0622232
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0391394
[11/24/2022-12:10:37] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:37] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0262156
[11/24/2022-12:10:37] [V] [TRT] Fastest Tactic: 5380043773350002416 Time: 0.0245646
[11/24/2022-12:10:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5380043773350002416
[11/24/2022-12:10:37] [V] [TRT] *************** Autotuning format combination: Half(221760,231,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:10:37] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudnnConvolution)
[11/24/2022-12:10:37] [V] [TRT] Tactic: 0 Time: 0.148411
[11/24/2022-12:10:37] [V] [TRT] Tactic: 1 Time: 0.115835
[11/24/2022-12:10:37] [V] [TRT] Tactic: 2 Time: 0.233536
[11/24/2022-12:10:38] [V] [TRT] Tactic: 4 Time: 16.9219
[11/24/2022-12:10:38] [V] [TRT] Tactic: 5 Time: 1.55591
[11/24/2022-12:10:38] [V] [TRT] Tactic: 56 Time: 0.148329
[11/24/2022-12:10:38] [V] [TRT] Tactic: 58 Time: 0.232622
[11/24/2022-12:10:39] [V] [TRT] Tactic: 60 Time: 16.916
[11/24/2022-12:10:39] [V] [TRT] Tactic: 61 Time: 1.54993
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: 1 Time: 0.115835
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1) -> Half(73920,231,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Half(110880,231:2,21,1) -> Half(36960,231:2,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (FusedConvActConvolution)
[11/24/2022-12:10:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Float(73920,231,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Half(27720,1:8,2520,120) -> Half(9240,1:8,840,40) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudaDepthwiseConvolution)
[11/24/2022-12:10:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:39] [V] [TRT] Tactic: 254850674756030979 Time: 0.035232
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0349678
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0221401
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1156328698016730421 Time: 0.036656
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0372389
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0158363
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0159299
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0158363
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1877373136269439559 Time: 0.020674
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1899296423087490472 Time: 0.020196
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2238656696610018305 Time: 0.015819
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0243566
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0334638
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0223301
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2968605903460894194 Time: 0.015967
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0244526
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0182989
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0222713
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0430046
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0345573
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0157934
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0157289
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0180726
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0159192
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0330222
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0205211
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0222903
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0398446
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0332325
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0265379
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0160152
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0349714
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0350446
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5205510332404400949 Time: 0.022543
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0205224
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0266667
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0156882
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0348763
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0223595
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0159868
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0160076
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0205179
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0202217
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0392366
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0158974
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0222472
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0202149
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0158578
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8764780417487154889 Time: 0.026816
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0138028
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0368309
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:39] [V] [TRT] Tactic: -9203179519031456182 Time: 0.018032
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:39] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0287159
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0224065
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0351122
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0332791
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0139952
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0212898
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0159756
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0205277
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0204944
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0224411
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0159523
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0235154
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0183811
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5261787675443473128 Time: 0.022334
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0158144
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5127240325355316006 Time: 0.015744
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0351515
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0159507
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0159203
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0201337
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0158501
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0200297
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0401303
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4021926646879732549 Time: 0.015792
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0159218
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0288311
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0265653
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0266682
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0201394
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3234716536615144018 Time: 0.020574
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0340846
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0158501
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0214655
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0223223
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0265417
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0158245
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0151278
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0287671
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1828674067637788567 Time: 0.024387
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0157495
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0212062
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0155534
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0207765
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0158318
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:39] [V] [TRT] Tactic: -406984317033388136 Time: 0.0333495
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:39] [V] [TRT] Tactic: -331499326992534460 Time: 0.0156667
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:39] [V] [TRT] Tactic: -206523504474952360 Time: 0.0207053
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: 8823554289762712606 Time: 0.0138028
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8823554289762712606
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Half(13860,1:16,1260,60) -> Half(4620,1:16,420,20) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Half(6930,231:32,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CublasConvolution)
[11/24/2022-12:10:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudaDepthwiseConvolution)
[11/24/2022-12:10:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0618971
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0604267
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0610499
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0390891
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0391943
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0453623
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0410217
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0388389
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0495497
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0435063
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:39] [V] [TRT] Tactic: -108011214168778087 Time: 0.0468697
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:39] [V] [TRT] Tactic: -42427192380281294 Time: 0.0372994
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: -42427192380281294 Time: 0.0372994
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -42427192380281294
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(18480,231:4,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudaDepthwiseConvolution)
[11/24/2022-12:10:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (FusedConvActConvolution)
[11/24/2022-12:10:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:39] [V] [TRT] Tactic: 175853789719975416 Time: 0.0474469
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0408046
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0360594
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0376629
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6299962968199310600 Time: 0.056253
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6341572697076960911 Time: 0.035211
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0436091
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0350235
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7303593854972602201 Time: 0.036792
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0579017
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0421566
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:39] [V] [TRT] Tactic: -683636008127039856 Time: 0.0579398
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.0350235
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(55440,231:4,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0437897
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0561158
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0371897
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0580785
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0350501
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0417097
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0351342
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0578865
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0362389
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0408937
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0474777
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:39] [V] [TRT] Tactic: -868495160148524802 Time: 0.0361829
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0350501
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(73920,231,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0156439
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0154176
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0157774
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: 5104832031493112835 Time: 0.0154176
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5104832031493112835
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Float(2310,231:32,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0159035
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0116962
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3721599319722771137 Time: 0.013701
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0225672
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0376149
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0244251
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0139345
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6969462133921577484 Time: 0.026675
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0135082
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0139246
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0116635
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0117405
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0117528
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0160437
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0264221
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0233326
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0266179
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0371646
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0117908
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0224483
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0369943
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0125775
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0121691
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0245074
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0240137
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:39] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0159086
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0264518
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0244975
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0137799
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0160371
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1610768292520086910 Time: 0.024496
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:39] [V] [TRT] Tactic: -621838502160440068 Time: 0.0245135
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: 7970271430402365872 Time: 0.0116635
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7970271430402365872
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Half(2310,231:32,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:39] [V] [TRT] Tactic: 424230345342282109 Time: 0.024557
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0138435
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2327398338581585326 Time: 0.024435
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2881044142075831475 Time: 0.011604
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0358114
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0134558
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0212748
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0226743
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0137238
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0350473
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00995718
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:39] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00989928
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0137903
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0140214
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:39] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00989349
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:39] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0132879
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0136154
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0133033
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:39] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0114771
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:39] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0244754
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0244655
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0204911
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:39] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0203531
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0224738
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:39] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0135909
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00998095
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0235716
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:39] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0209058
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:39] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0141153
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1712174008006584201 Time: 0.035061
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:39] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0225032
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:39] [V] [TRT] Tactic: -50323486981480818 Time: 0.0244678
[11/24/2022-12:10:39] [V] [TRT] Fastest Tactic: 8471142395703548718 Time: 0.00989349
[11/24/2022-12:10:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8471142395703548718
[11/24/2022-12:10:39] [V] [TRT] *************** Autotuning format combination: Int8(6930,231:32,21,1) -> Int8(2310,231:32,21,1) ***************
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudaGroupConvolution)
[11/24/2022-12:10:39] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CudaDepthwiseConvolution)
[11/24/2022-12:10:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (FusedConvActConvolution)
[11/24/2022-12:10:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:39] [V] [TRT] --------------- Timing Runner: node_of_655 + node_of_656 (CaskConvolution)
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:39] [V] [TRT] Tactic: 125145153013230687 Time: 0.016606
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0116825
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0115555
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:39] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0115323
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:39] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00974385
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0116972
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0114511
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:39] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0130485
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0139233
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00982126
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:39] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0113822
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00951857
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0114078
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0134163
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:39] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0097405
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0167944
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:39] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0115485
[11/24/2022-12:10:39] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0137729
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0130664
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0160874
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00992457
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0135136
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0137263
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0138518
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0117022
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8142283985160822229 Time: 0.020208
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8173975624668590862 Time: 0.020188
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0204173
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0112591
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0121752
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:40] [V] [TRT] Tactic: -8638624340850784688 Time: 0.011789
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:40] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0125143
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0121981
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0143081
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0176955
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:40] [V] [TRT] Tactic: -5671123121710113970 Time: 0.012107
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:40] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0176985
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:40] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0113294
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0122126
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0232202
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0123299
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0179029
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:40] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0130992
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:40] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0153207
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:40] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0178149
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:40] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0121227
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:40] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0122373
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:40] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0209287
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1916483171117495388 Time: 0.015035
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0179229
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0118414
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0122149
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:40] [V] [TRT] Tactic: -405554772060757402 Time: 0.0100894
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:40] [V] [TRT] Tactic: -375949437730908730 Time: 0.0119219
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:40] [V] [TRT] Tactic: -111878368089469751 Time: 0.0234083
[11/24/2022-12:10:40] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:40] [V] [TRT] Tactic: -19707840769375107 Time: 0.0119237
[11/24/2022-12:10:40] [V] [TRT] Fastest Tactic: 5204702486885981735 Time: 0.00951857
[11/24/2022-12:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5204702486885981735
[11/24/2022-12:10:40] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:40] [V] [TRT] *************** Autotuning format combination: Float(73920,231,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudaDepthwiseConvolution)
[11/24/2022-12:10:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (FusedConvActConvolution)
[11/24/2022-12:10:40] [V] [TRT] Tactic: 589823 Time: 0.094304
[11/24/2022-12:10:40] [V] [TRT] Tactic: 655359 Time: 0.0610545
[11/24/2022-12:10:40] [V] [TRT] Tactic: 786431 Time: 0.0308562
[11/24/2022-12:10:40] [V] [TRT] Tactic: 851967 Time: 0.0259162
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1179647 Time: 0.0235513
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1638399 Time: 0.0259566
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2097151 Time: 0.0192543
[11/24/2022-12:10:40] [V] [TRT] Tactic: 3538943 Time: 0.0287817
[11/24/2022-12:10:40] [V] [TRT] Tactic: 3932159 Time: 0.0555733
[11/24/2022-12:10:40] [V] [TRT] Tactic: 3997695 Time: 0.0234162
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4194303 Time: 0.031531
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4259839 Time: 0.020593
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4587519 Time: 0.023326
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4653055 Time: 0.02339
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4915199 Time: 0.023294
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4980735 Time: 0.0394594
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5177343 Time: 0.0259086
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5242879 Time: 0.0343397
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5373951 Time: 0.0246438
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5570559 Time: 0.0369109
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5767167 Time: 0.0364217
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5898239 Time: 0.023648
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6225919 Time: 0.0268747
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6291455 Time: 0.0236186
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6815743 Time: 0.0368206
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7012351 Time: 0.0194994
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7077887 Time: 0.0289929
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7143423 Time: 0.0343698
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7208959 Time: 0.0398926
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7340031 Time: 0.026
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7536639 Time: 0.0506042
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7733247 Time: 0.0315721
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8191999 Time: 0.0259314
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8716287 Time: 0.0286181
[11/24/2022-12:10:40] [V] [TRT] Tactic: 9109503 Time: 0.0261531
[11/24/2022-12:10:40] [V] [TRT] Tactic: 9568255 Time: 0.0232875
[11/24/2022-12:10:40] [V] [TRT] Tactic: 10354687 Time: 0.0235527
[11/24/2022-12:10:40] [V] [TRT] Tactic: 10747903 Time: 0.0310875
[11/24/2022-12:10:40] [V] [TRT] Fastest Tactic: 2097151 Time: 0.0192543
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudnnConvolution)
[11/24/2022-12:10:40] [V] [TRT] Tactic: 0 Time: 0.0464766
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1 Time: 0.0674179
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2 Time: 0.113573
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4 Time: 2.46287
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5 Time: 0.303109
[11/24/2022-12:10:40] [V] [TRT] Tactic: 56 Time: 0.0504457
[11/24/2022-12:10:40] [V] [TRT] Tactic: 57 Time: 0.0674987
[11/24/2022-12:10:40] [V] [TRT] Tactic: 58 Time: 0.115248
[11/24/2022-12:10:40] [V] [TRT] Tactic: 60 Time: 2.45578
[11/24/2022-12:10:40] [V] [TRT] Tactic: 61 Time: 0.3
[11/24/2022-12:10:40] [V] [TRT] Tactic: 112 Time: 0.051453
[11/24/2022-12:10:40] [V] [TRT] Tactic: 113 Time: 0.0551482
[11/24/2022-12:10:40] [V] [TRT] Tactic: 114 Time: 0.113509
[11/24/2022-12:10:40] [V] [TRT] Tactic: 116 Time: 2.46392
[11/24/2022-12:10:40] [V] [TRT] Tactic: 117 Time: 0.301426
[11/24/2022-12:10:40] [V] [TRT] Fastest Tactic: 0 Time: 0.0464766
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:10:40] [V] [TRT] Tactic: 621442388677115936 Time: 0.0231876
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:10:40] [V] [TRT] Tactic: 697756878388249475 Time: 0.0148119
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0232594
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0153422
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0260709
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0446697
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:10:40] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0723543
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0255611
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0479101
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0319863
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0609996
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0505189
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0354615
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0369817
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0262537
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6723161876874263939 Time: 0.034187
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0204663
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0175045
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0370057
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:10:40] [V] [TRT] Tactic: 9151672657204310840 Time: 0.031413
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:10:40] [V] [TRT] Tactic: -8877086111929938764 Time: 0.047872
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:10:40] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0260556
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:10:40] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0397314
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:10:40] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0560716
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:10:40] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0380629
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:10:40] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0711604
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0301778
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0586392
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0605577
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0396434
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0475474
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:10:40] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0451691
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0418891
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0178834
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0626636
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:10:40] [V] [TRT] Tactic: -701551393537224327 Time: 0.0508754
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:10:40] [V] [TRT] Tactic: -3258434593395023 Time: 0.120894
[11/24/2022-12:10:40] [V] [TRT] Fastest Tactic: 697756878388249475 Time: 0.0148119
[11/24/2022-12:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 697756878388249475
[11/24/2022-12:10:40] [V] [TRT] *************** Autotuning format combination: Float(73920,1,6720,320) -> Float(22176,1,2016,96) ***************
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0345902
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0614903
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2860655430572478466 Time: 0.039176
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:10:40] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0348215
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0258796
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0259665
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0396606
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0614537
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0234795
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:10:40] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0589044
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:10:40] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0235879
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:10:40] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0345563
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0612617
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0342839
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:10:40] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0237153
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:10:40] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0344
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:10:40] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0613227
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0589349
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:10:40] [V] [TRT] Tactic: -504296718212024303 Time: 0.0585661
[11/24/2022-12:10:40] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0234795
[11/24/2022-12:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:10:40] [V] [TRT] *************** Autotuning format combination: Float(18480,1:4,1680,80) -> Float(5544,1:4,504,24) ***************
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0233763
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0206243
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:10:40] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0148306
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0119554
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0150034
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0204408
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0200497
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6419443404913215692 Time: 0.028971
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0287726
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:10:40] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0147758
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:10:40] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0154363
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:10:40] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0102589
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:10:40] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0236911
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0122728
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:10:40] [V] [TRT] Tactic: -6073218138311523634 Time: 0.028853
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:10:40] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0147744
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:10:40] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0188886
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0288978
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0114504
[11/24/2022-12:10:40] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:10:40] [V] [TRT] Tactic: -1138876066247138089 Time: 0.015013
[11/24/2022-12:10:40] [V] [TRT] Fastest Tactic: -8853476220903838035 Time: 0.0102589
[11/24/2022-12:10:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8853476220903838035
[11/24/2022-12:10:40] [V] [TRT] *************** Autotuning format combination: Half(73920,231,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:10:40] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudnnConvolution)
[11/24/2022-12:10:40] [V] [TRT] Tactic: 0 Time: 0.0512442
[11/24/2022-12:10:40] [V] [TRT] Tactic: 1 Time: 0.0650469
[11/24/2022-12:10:40] [V] [TRT] Tactic: 2 Time: 0.147424
[11/24/2022-12:10:40] [V] [TRT] Tactic: 4 Time: 2.44721
[11/24/2022-12:10:40] [V] [TRT] Tactic: 5 Time: 0.228078
[11/24/2022-12:10:40] [V] [TRT] Tactic: 56 Time: 0.0499154
[11/24/2022-12:10:40] [V] [TRT] Tactic: 58 Time: 0.145975
[11/24/2022-12:10:41] [V] [TRT] Tactic: 60 Time: 2.45183
[11/24/2022-12:10:41] [V] [TRT] Tactic: 61 Time: 0.296411
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: 56 Time: 0.0499154
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Half(36960,231:2,21,1) -> Half(22176,231,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Half(36960,231:2,21,1) -> Half(11088,231:2,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (FusedConvActConvolution)
[11/24/2022-12:10:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Half(9240,1:8,840,40) -> Float(22176,231,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Half(9240,1:8,840,40) -> Half(2772,1:8,252,12) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudaDepthwiseConvolution)
[11/24/2022-12:10:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:10:41] [V] [TRT] Tactic: 254850674756030979 Time: 0.0179914
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0180463
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0144375
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0181034
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0180931
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0120617
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0120815
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0120819
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0127486
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1899296423087490472 Time: 0.00995779
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2238656696610018305 Time: 0.011616
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0147534
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0177519
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2657157263811141609 Time: 0.010002
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0120472
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3071479995783211391 Time: 0.00892208
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0119859
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0147497
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0207817
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0177961
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3899310434460415852 Time: 0.00910914
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0117433
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0119082
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0107082
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0177209
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4528997467275241200 Time: 0.012605
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0151259
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0204826
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0178577
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0151822
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0104362
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0178321
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0179331
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0142889
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0127021
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0155529
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0106704
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0179669
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0149531
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0123783
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0100678
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0137588
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6859477213531075460 Time: 0.00992396
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0204225
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0119661
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0146633
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0102844
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0122137
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0154843
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00982034
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0182446
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:10:41] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00936114
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:10:41] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0161981
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0100154
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0178971
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0177189
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0101333
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00984137
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0102142
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00959908
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6768327495007644783 Time: 0.012605
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0117113
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0119848
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5530886555766748586 Time: 0.014885
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00940971
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0150798
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0121013
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0113688
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0184514
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00939086
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0121013
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4548822885169694805 Time: 0.00976061
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0119208
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00963566
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0207562
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0118094
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0121383
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0176137
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0152005
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0152855
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00988952
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0128739
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0178989
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0120602
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0127398
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0142063
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0152955
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0121269
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0100727
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0158245
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00910971
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0118259
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0126091
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0105234
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1099247066487349374 Time: 0.00983558
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0118432
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:10:41] [V] [TRT] Tactic: -406984317033388136 Time: 0.0178204
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:10:41] [V] [TRT] Tactic: -331499326992534460 Time: 0.0106465
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:10:41] [V] [TRT] Tactic: -206523504474952360 Time: 0.0127379
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: 3071479995783211391 Time: 0.00892208
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3071479995783211391
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Half(4620,1:16,420,20) -> Half(1386,1:16,126,6) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Half(2310,231:32,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CublasConvolution)
[11/24/2022-12:10:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(18480,231:4,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudaDepthwiseConvolution)
[11/24/2022-12:10:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0289143
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0288046
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0289253
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0207229
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0206446
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0231948
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0213107
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0209365
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2297737319934264721 Time: 0.023599
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1425085658556684465 Time: 0.023134
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:10:41] [V] [TRT] Tactic: -108011214168778087 Time: 0.0232888
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:10:41] [V] [TRT] Tactic: -42427192380281294 Time: 0.0207595
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: 7621465827583909090 Time: 0.0206446
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7621465827583909090
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(18480,231:4,21,1) -> Int8(5544,231:4,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudaDepthwiseConvolution)
[11/24/2022-12:10:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (FusedConvActConvolution)
[11/24/2022-12:10:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:10:41] [V] [TRT] Tactic: 175853789719975416 Time: 0.0211709
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0204767
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0180554
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0181286
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0260785
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0179469
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0206302
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8498217049614706532 Time: 0.017884
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0179257
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0260465
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0204126
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:10:41] [V] [TRT] Tactic: -683636008127039856 Time: 0.0261303
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.017884
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(18480,231:4,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0205388
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0260076
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0181314
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0259832
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8803458114157674373 Time: 0.017821
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0204754
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0178077
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0259947
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3958182351168863467 Time: 0.017824
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0204362
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0209371
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:10:41] [V] [TRT] Tactic: -868495160148524802 Time: 0.0178524
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: -4431642509665791294 Time: 0.0178077
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4431642509665791294
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(2310,231:32,21,1) -> Float(22176,231,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3426497547019031858 Time: 0.00971733
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0124415
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5287526117701381005 Time: 0.00936
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: -5287526117701381005 Time: 0.00936
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5287526117701381005
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(2310,231:32,21,1) -> Float(693,231:32,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0123745
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00990446
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00731383
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0150555
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0186691
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0149815
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6618077155362058131 Time: 0.00745806
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0150144
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7348718297764976805 Time: 0.00743314
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7869897696365535632 Time: 0.00753396
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7970271430402365872 Time: 0.00929228
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00956922
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8912999970161746151 Time: 0.00925171
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0125265
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0155232
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0149111
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0151035
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0183
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00885378
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0149367
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0183697
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00719131
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6406011580107094428 Time: 0.00911029
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0151008
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5416590980288859834 Time: 0.014976
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0119072
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0173435
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0151127
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0075508
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0121223
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0150267
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:10:41] [V] [TRT] Tactic: -621838502160440068 Time: 0.0152704
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.00719131
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(2310,231:32,21,1) -> Half(693,231:32,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:10:41] [V] [TRT] Tactic: 424230345342282109 Time: 0.0151831
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0096192
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0150423
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0080574
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0181069
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0075751
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0126179
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0149358
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7507411019787288861 Time: 0.010062
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0181029
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00901229
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00902429
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00981638
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0073216
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00922429
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:10:41] [V] [TRT] Tactic: 9072692108481390634 Time: 0.00737349
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00957714
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0073696
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00752206
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0151333
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0150341
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0124099
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0125227
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0149234
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00735131
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00944343
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0149381
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0128571
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00729189
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0180531
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0149797
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:10:41] [V] [TRT] Tactic: -50323486981480818 Time: 0.0150286
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: -2649556861007671996 Time: 0.00729189
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2649556861007671996
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Int8(2310,231:32,21,1) -> Int8(693,231:32,21,1) ***************
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudaGroupConvolution)
[11/24/2022-12:10:41] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CudaDepthwiseConvolution)
[11/24/2022-12:10:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (FusedConvActConvolution)
[11/24/2022-12:10:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:41] [V] [TRT] --------------- Timing Runner: node_of_657 + node_of_658 + node_of_659 (CaskConvolution)
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:10:41] [V] [TRT] Tactic: 125145153013230687 Time: 0.0120339
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1583811548148740665 Time: 0.00924629
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1701344857577810806 Time: 0.00948086
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:10:41] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00736434
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:10:41] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00885405
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00741417
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00762394
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:10:41] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00761287
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00746377
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00893229
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:10:41] [V] [TRT] Tactic: 4796956614760326119 Time: 0.009344
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00772307
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00918628
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00977768
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:10:41] [V] [TRT] Tactic: 5986622376339202983 Time: 0.00771753
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0121131
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00931428
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6433368103202497147 Time: 0.010034
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00730171
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0119421
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00933828
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00962133
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6925201228918187099 Time: 0.00988069
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:10:41] [V] [TRT] Tactic: 6991524515605108718 Time: 0.00984594
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:10:41] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00923229
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0121516
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0126164
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0123318
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00923
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:10:41] [V] [TRT] Tactic: 8765382722978397630 Time: 0.00916714
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:10:41] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00901228
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:10:41] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00748731
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00917343
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0077926
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:10:41] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0119429
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00907371
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0118126
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:10:41] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00837968
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00758569
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0124846
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00933886
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:10:41] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0119131
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00711989
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00757871
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:10:41] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0118794
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00941429
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2432868635536396215 Time: 0.00929371
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:10:41] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0126968
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1916483171117495388 Time: 0.00964998
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1549742793039499659 Time: 0.012069
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1328736756812546664 Time: 0.00836292
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:10:41] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00729074
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:10:41] [V] [TRT] Tactic: -405554772060757402 Time: 0.00797917
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:10:41] [V] [TRT] Tactic: -375949437730908730 Time: 0.00927257
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:10:41] [V] [TRT] Tactic: -111878368089469751 Time: 0.0125341
[11/24/2022-12:10:41] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:10:41] [V] [TRT] Tactic: -19707840769375107 Time: 0.00889681
[11/24/2022-12:10:41] [V] [TRT] Fastest Tactic: -3825889760337461729 Time: 0.00711989
[11/24/2022-12:10:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3825889760337461729
[11/24/2022-12:10:41] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:41] [V] [TRT] *************** Autotuning format combination: Float(22176,231,21,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] Tactic: 0 Time: 0.0343314
[11/24/2022-12:10:42] [V] [TRT] Tactic: 1 Time: 0.0341595
[11/24/2022-12:10:42] [V] [TRT] Tactic: 3 Time: 4.84826
[11/24/2022-12:10:42] [V] [TRT] Tactic: 24 Time: 0.898766
[11/24/2022-12:10:42] [V] [TRT] Tactic: 27 Time: 7.88721
[11/24/2022-12:10:42] [V] [TRT] Fastest Tactic: 1 Time: 0.0341595
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] Tactic: 0 Time: 1.44756
[11/24/2022-12:10:42] [V] [TRT] Fastest Tactic: 0 Time: 1.44756
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] node_of_660 Set Tactic Name: sm50_xmma_deconv_generic_f32f32_f32_f32_nchwkcrs_nchw Tactic: 1108745107350470483
[11/24/2022-12:10:42] [V] [TRT] Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:10:42] [V] [TRT] Fastest Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:10:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Float(22176,1,2016,96) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] node_of_660 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 1461874880923808087
[11/24/2022-12:10:42] [V] [TRT] Tactic: 1461874880923808087 Time: 1.14709
[11/24/2022-12:10:42] [V] [TRT] node_of_660 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x128x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2647374945310797548
[11/24/2022-12:10:42] [V] [TRT] Tactic: 2647374945310797548 Time: 3.491
[11/24/2022-12:10:42] [V] [TRT] node_of_660 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -5631711556980973584
[11/24/2022-12:10:42] [V] [TRT] Tactic: -5631711556980973584 Time: 5.74682
[11/24/2022-12:10:42] [V] [TRT] Fastest Tactic: 1461874880923808087 Time: 1.14709
[11/24/2022-12:10:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskDeconvolutionV2 Tactic: 1461874880923808087
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Float(5544,1:4,504,24) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Half(22176,231,21,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] Tactic: 0 Time: 0.0371611
[11/24/2022-12:10:42] [V] [TRT] Tactic: 1 Time: 0.0363269
[11/24/2022-12:10:42] [V] [TRT] Tactic: 3 Time: 4.86138
[11/24/2022-12:10:42] [V] [TRT] Tactic: 24 Time: 1.10298
[11/24/2022-12:10:42] [V] [TRT] Tactic: 27 Time: 7.96667
[11/24/2022-12:10:42] [V] [TRT] Fastest Tactic: 1 Time: 0.0363269
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] Tactic: 0 Time: 1.30302
[11/24/2022-12:10:42] [V] [TRT] Fastest Tactic: 0 Time: 1.30302
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Half(11088,231:2,21,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Half(2772,1:8,252,12) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Half(1386,1:16,126,6) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Half(693,231:32,21,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Int8(5544,231:4,21,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Int8(5544,231:4,21,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Int8(693,231:32,21,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Int8(693,231:32,21,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Int8(693,231:32,21,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CudnnDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (GemmDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolution)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: node_of_660 (CaskDeconvolutionV2)
[11/24/2022-12:10:42] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:10:42] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:10:42] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1), Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:10:42] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:10:42] [V] [TRT] Tactic: 0 Time: 0.00829155
[11/24/2022-12:10:43] [V] [TRT] Tactic: 1 Time: 0.00718514
[11/24/2022-12:10:43] [V] [TRT] Tactic: 2 Time: 0.00685976
[11/24/2022-12:10:43] [V] [TRT] Tactic: 3 Time: 0.00695184
[11/24/2022-12:10:44] [V] [TRT] Tactic: 4 Time: 0.00667553
[11/24/2022-12:10:44] [V] [TRT] Tactic: 5 Time: 0.00680272
[11/24/2022-12:10:44] [V] [TRT] Tactic: 6 Time: 0.0068271
[11/24/2022-12:10:45] [V] [TRT] Tactic: 7 Time: 0.00677527
[11/24/2022-12:10:45] [V] [TRT] Tactic: 8 Time: 0.00685584
[11/24/2022-12:10:45] [V] [TRT] Tactic: 9 Time: 0.00699755
[11/24/2022-12:10:45] [V] [TRT] Tactic: 28 Time: 0.00756908
[11/24/2022-12:10:45] [V] [TRT] Fastest Tactic: 4 Time: 0.00667553
[11/24/2022-12:10:45] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:10:45] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:10:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4
[11/24/2022-12:10:45] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96), Float(88704,1,4032,96) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:10:45] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:10:45] [V] [TRT] Tactic: 0 Time: 0.00831137
[11/24/2022-12:10:45] [V] [TRT] Tactic: 1 Time: 0.00712163
[11/24/2022-12:10:45] [V] [TRT] Tactic: 2 Time: 0.00683233
[11/24/2022-12:10:45] [V] [TRT] Tactic: 3 Time: 0.00689676
[11/24/2022-12:10:45] [V] [TRT] Tactic: 4 Time: 0.00671834
[11/24/2022-12:10:45] [V] [TRT] Tactic: 5 Time: 0.00674618
[11/24/2022-12:10:45] [V] [TRT] Tactic: 6 Time: 0.0069342
[11/24/2022-12:10:45] [V] [TRT] Tactic: 7 Time: 0.00678151
[11/24/2022-12:10:45] [V] [TRT] Tactic: 8 Time: 0.0067466
[11/24/2022-12:10:45] [V] [TRT] Tactic: 9 Time: 0.00717669
[11/24/2022-12:10:45] [V] [TRT] Tactic: 28 Time: 0.00743223
[11/24/2022-12:10:45] [V] [TRT] Fastest Tactic: 4 Time: 0.00671834
[11/24/2022-12:10:45] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:10:45] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:10:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4
[11/24/2022-12:10:45] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24), Float(22176,1:4,1008,24) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:10:45] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:10:46] [V] [TRT] Tactic: 0 Time: 0.00956891
[11/24/2022-12:10:46] [V] [TRT] Tactic: 1 Time: 0.00941657
[11/24/2022-12:10:46] [V] [TRT] Tactic: 2 Time: 0.00984838
[11/24/2022-12:10:47] [V] [TRT] Tactic: 3 Time: 0.00936857
[11/24/2022-12:10:47] [V] [TRT] Tactic: 4 Time: 0.009372
[11/24/2022-12:10:47] [V] [TRT] Tactic: 5 Time: 0.00937314
[11/24/2022-12:10:48] [V] [TRT] Tactic: 6 Time: 0.00954941
[11/24/2022-12:10:48] [V] [TRT] Tactic: 7 Time: 0.00937371
[11/24/2022-12:10:48] [V] [TRT] Tactic: 8 Time: 0.00945629
[11/24/2022-12:10:49] [V] [TRT] Tactic: 9 Time: 0.0101026
[11/24/2022-12:10:49] [V] [TRT] Tactic: 10 Time: 0.00931657
[11/24/2022-12:10:49] [V] [TRT] Tactic: 11 Time: 0.00927971
[11/24/2022-12:10:50] [V] [TRT] Tactic: 12 Time: 0.00959695
[11/24/2022-12:10:50] [V] [TRT] Tactic: 13 Time: 0.00936971
[11/24/2022-12:10:50] [V] [TRT] Tactic: 14 Time: 0.00941828
[11/24/2022-12:10:51] [V] [TRT] Tactic: 15 Time: 0.00997486
[11/24/2022-12:10:51] [V] [TRT] Tactic: 16 Time: 0.00943629
[11/24/2022-12:10:51] [V] [TRT] Tactic: 17 Time: 0.00930343
[11/24/2022-12:10:51] [V] [TRT] Tactic: 18 Time: 0.00941943
[11/24/2022-12:10:52] [V] [TRT] Tactic: 19 Time: 0.00909286
[11/24/2022-12:10:52] [V] [TRT] Tactic: 20 Time: 0.00918229
[11/24/2022-12:10:52] [V] [TRT] Tactic: 21 Time: 0.00737531
[11/24/2022-12:10:53] [V] [TRT] Tactic: 22 Time: 0.00723726
[11/24/2022-12:10:53] [V] [TRT] Tactic: 23 Time: 0.0101141
[11/24/2022-12:10:53] [V] [TRT] Tactic: 28 Time: 0.0131711
[11/24/2022-12:10:54] [V] [TRT] Tactic: 29 Time: 0.016163
[11/24/2022-12:10:54] [V] [TRT] Tactic: 30 Time: 0.0271139
[11/24/2022-12:10:54] [V] [TRT] Fastest Tactic: 22 Time: 0.00723726
[11/24/2022-12:10:54] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:10:54] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:10:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 22
[11/24/2022-12:10:54] [V] [TRT] *************** Autotuning format combination: Float(2772,924:32,42,1), Float(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:10:54] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:10:54] [V] [TRT] Tactic: 24 Time: 0.0414971
[11/24/2022-12:10:54] [V] [TRT] Tactic: 25 Time: 0.0411223
[11/24/2022-12:10:55] [V] [TRT] Tactic: 26 Time: 0.0411566
[11/24/2022-12:10:55] [V] [TRT] Tactic: 27 Time: 0.0465966
[11/24/2022-12:10:55] [V] [TRT] Tactic: 31 Time: 0.0414811
[11/24/2022-12:10:55] [V] [TRT] Fastest Tactic: 25 Time: 0.0411223
[11/24/2022-12:10:55] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:10:55] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:10:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25
[11/24/2022-12:10:55] [V] [TRT] *************** Autotuning format combination: Float(1:4,924,42,1), Float(1:4,924,42,1) -> Float(1:4,924,42,1) ***************
[11/24/2022-12:10:55] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:10:56] [V] [TRT] Tactic: 0 Time: 1.15452
[11/24/2022-12:10:56] [V] [TRT] Tactic: 1 Time: 1.49535
[11/24/2022-12:10:56] [V] [TRT] Tactic: 2 Time: 1.41089
[11/24/2022-12:10:57] [V] [TRT] Tactic: 3 Time: 2.05468
[11/24/2022-12:10:57] [V] [TRT] Tactic: 4 Time: 2.09491
[11/24/2022-12:10:57] [V] [TRT] Tactic: 5 Time: 1.50847
[11/24/2022-12:10:58] [V] [TRT] Tactic: 6 Time: 3.1578
[11/24/2022-12:10:58] [V] [TRT] Tactic: 7 Time: 2.84969
[11/24/2022-12:10:58] [V] [TRT] Tactic: 8 Time: 2.95954
[11/24/2022-12:10:59] [V] [TRT] Tactic: 9 Time: 3.10004
[11/24/2022-12:10:59] [V] [TRT] Tactic: 10 Time: 1.95483
[11/24/2022-12:11:00] [V] [TRT] Tactic: 11 Time: 4.48077
[11/24/2022-12:11:00] [V] [TRT] Tactic: 12 Time: 2.2228
[11/24/2022-12:11:00] [V] [TRT] Tactic: 13 Time: 3.6625
[11/24/2022-12:11:01] [V] [TRT] Tactic: 14 Time: 1.7907
[11/24/2022-12:11:01] [V] [TRT] Tactic: 15 Time: 1.22599
[11/24/2022-12:11:01] [V] [TRT] Tactic: 16 Time: 2.92534
[11/24/2022-12:11:02] [V] [TRT] Tactic: 17 Time: 2.29721
[11/24/2022-12:11:02] [V] [TRT] Tactic: 18 Time: 2.31748
[11/24/2022-12:11:02] [V] [TRT] Tactic: 19 Time: 1.52087
[11/24/2022-12:11:03] [V] [TRT] Tactic: 20 Time: 0.874853
[11/24/2022-12:11:03] [V] [TRT] Tactic: 21 Time: 1.22891
[11/24/2022-12:11:03] [V] [TRT] Tactic: 22 Time: 1.61015
[11/24/2022-12:11:04] [V] [TRT] Tactic: 23 Time: 2.38406
[11/24/2022-12:11:04] [V] [TRT] Tactic: 28 Time: 0.160599
[11/24/2022-12:11:04] [V] [TRT] Tactic: 29 Time: 0.15445
[11/24/2022-12:11:04] [V] [TRT] Tactic: 30 Time: 0.126075
[11/24/2022-12:11:04] [V] [TRT] Fastest Tactic: 30 Time: 0.126075
[11/24/2022-12:11:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 30
[11/24/2022-12:11:04] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1), Half(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:11:04] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:05] [V] [TRT] Tactic: 0 Time: 0.0349458
[11/24/2022-12:11:05] [V] [TRT] Tactic: 1 Time: 0.0317449
[11/24/2022-12:11:05] [V] [TRT] Tactic: 2 Time: 0.0284625
[11/24/2022-12:11:06] [V] [TRT] Tactic: 3 Time: 0.0286363
[11/24/2022-12:11:06] [V] [TRT] Tactic: 4 Time: 0.0284968
[11/24/2022-12:11:06] [V] [TRT] Tactic: 5 Time: 0.028381
[11/24/2022-12:11:07] [V] [TRT] Tactic: 6 Time: 0.0285861
[11/24/2022-12:11:07] [V] [TRT] Tactic: 7 Time: 0.0286336
[11/24/2022-12:11:07] [V] [TRT] Tactic: 8 Time: 0.028355
[11/24/2022-12:11:07] [V] [TRT] Tactic: 9 Time: 0.0284541
[11/24/2022-12:11:08] [V] [TRT] Tactic: 28 Time: 0.0348242
[11/24/2022-12:11:08] [V] [TRT] Fastest Tactic: 8 Time: 0.028355
[11/24/2022-12:11:08] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:11:08] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:11:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
[11/24/2022-12:11:08] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1), Half(44352,924:2,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:11:08] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:08] [V] [TRT] Tactic: 0 Time: 0.0328338
[11/24/2022-12:11:08] [V] [TRT] Tactic: 1 Time: 0.0347895
[11/24/2022-12:11:09] [V] [TRT] Tactic: 2 Time: 0.033568
[11/24/2022-12:11:09] [V] [TRT] Tactic: 3 Time: 0.0348242
[11/24/2022-12:11:09] [V] [TRT] Tactic: 4 Time: 0.0327305
[11/24/2022-12:11:10] [V] [TRT] Tactic: 5 Time: 0.0286007
[11/24/2022-12:11:10] [V] [TRT] Tactic: 6 Time: 0.0348425
[11/24/2022-12:11:10] [V] [TRT] Tactic: 7 Time: 0.0348846
[11/24/2022-12:11:10] [V] [TRT] Tactic: 8 Time: 0.0348123
[11/24/2022-12:11:11] [V] [TRT] Tactic: 9 Time: 0.0347621
[11/24/2022-12:11:11] [V] [TRT] Tactic: 10 Time: 0.041112
[11/24/2022-12:11:11] [V] [TRT] Tactic: 11 Time: 0.0348709
[11/24/2022-12:11:12] [V] [TRT] Tactic: 12 Time: 0.0348114
[11/24/2022-12:11:12] [V] [TRT] Tactic: 13 Time: 0.0348133
[11/24/2022-12:11:12] [V] [TRT] Tactic: 14 Time: 0.0289984
[11/24/2022-12:11:13] [V] [TRT] Tactic: 15 Time: 0.0285888
[11/24/2022-12:11:13] [V] [TRT] Tactic: 16 Time: 0.0297289
[11/24/2022-12:11:13] [V] [TRT] Tactic: 17 Time: 0.0284914
[11/24/2022-12:11:14] [V] [TRT] Tactic: 18 Time: 0.028629
[11/24/2022-12:11:14] [V] [TRT] Tactic: 19 Time: 0.0295287
[11/24/2022-12:11:14] [V] [TRT] Tactic: 28 Time: 0.0331749
[11/24/2022-12:11:14] [V] [TRT] Tactic: 29 Time: 0.0411509
[11/24/2022-12:11:14] [V] [TRT] Fastest Tactic: 17 Time: 0.0284914
[11/24/2022-12:11:14] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:11:14] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:11:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 17
[11/24/2022-12:11:14] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12), Half(11088,1:8,504,12) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:11:14] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:15] [V] [TRT] Tactic: 0 Time: 0.0286034
[11/24/2022-12:11:15] [V] [TRT] Tactic: 1 Time: 0.0299794
[11/24/2022-12:11:15] [V] [TRT] Tactic: 2 Time: 0.0284587
[11/24/2022-12:11:16] [V] [TRT] Tactic: 3 Time: 0.0348507
[11/24/2022-12:11:16] [V] [TRT] Tactic: 4 Time: 0.0348343
[11/24/2022-12:11:16] [V] [TRT] Tactic: 5 Time: 0.0347785
[11/24/2022-12:11:17] [V] [TRT] Tactic: 6 Time: 0.0411314
[11/24/2022-12:11:17] [V] [TRT] Tactic: 7 Time: 0.0419829
[11/24/2022-12:11:17] [V] [TRT] Tactic: 8 Time: 0.0454331
[11/24/2022-12:11:18] [V] [TRT] Tactic: 9 Time: 0.0474091
[11/24/2022-12:11:18] [V] [TRT] Tactic: 10 Time: 0.0285906
[11/24/2022-12:11:19] [V] [TRT] Tactic: 11 Time: 0.0287515
[11/24/2022-12:11:19] [V] [TRT] Tactic: 12 Time: 0.0286299
[11/24/2022-12:11:19] [V] [TRT] Tactic: 13 Time: 0.0343817
[11/24/2022-12:11:19] [V] [TRT] Tactic: 14 Time: 0.0309952
[11/24/2022-12:11:20] [V] [TRT] Tactic: 15 Time: 0.0291867
[11/24/2022-12:11:20] [V] [TRT] Tactic: 16 Time: 0.0348306
[11/24/2022-12:11:20] [V] [TRT] Tactic: 17 Time: 0.0355365
[11/24/2022-12:11:21] [V] [TRT] Tactic: 18 Time: 0.0370229
[11/24/2022-12:11:21] [V] [TRT] Tactic: 19 Time: 0.0411291
[11/24/2022-12:11:22] [V] [TRT] Tactic: 20 Time: 0.0334839
[11/24/2022-12:11:22] [V] [TRT] Tactic: 21 Time: 0.0348471
[11/24/2022-12:11:22] [V] [TRT] Tactic: 22 Time: 0.0348233
[11/24/2022-12:11:22] [V] [TRT] Tactic: 23 Time: 0.0348443
[11/24/2022-12:11:23] [V] [TRT] Tactic: 24 Time: 0.041104
[11/24/2022-12:11:23] [V] [TRT] Tactic: 25 Time: 0.0349211
[11/24/2022-12:11:23] [V] [TRT] Tactic: 26 Time: 0.0347575
[11/24/2022-12:11:24] [V] [TRT] Tactic: 27 Time: 0.0293504
[11/24/2022-12:11:24] [V] [TRT] Tactic: 28 Time: 0.0285742
[11/24/2022-12:11:24] [V] [TRT] Tactic: 29 Time: 0.0289033
[11/24/2022-12:11:25] [V] [TRT] Tactic: 30 Time: 0.0345947
[11/24/2022-12:11:25] [V] [TRT] Tactic: 31 Time: 0.0411554
[11/24/2022-12:11:25] [V] [TRT] Fastest Tactic: 2 Time: 0.0284587
[11/24/2022-12:11:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:11:25] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:11:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[11/24/2022-12:11:25] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6), Half(5544,1:16,252,6) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:11:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:25] [V] [TRT] Tactic: 10 Time: 0.0286949
[11/24/2022-12:11:25] [V] [TRT] Tactic: 11 Time: 0.0298661
[11/24/2022-12:11:26] [V] [TRT] Tactic: 12 Time: 0.0600259
[11/24/2022-12:11:26] [V] [TRT] Tactic: 13 Time: 0.0600396
[11/24/2022-12:11:26] [V] [TRT] Tactic: 14 Time: 0.0605958
[11/24/2022-12:11:27] [V] [TRT] Tactic: 15 Time: 0.0626164
[11/24/2022-12:11:27] [V] [TRT] Tactic: 16 Time: 0.0710049
[11/24/2022-12:11:27] [V] [TRT] Tactic: 17 Time: 0.0821143
[11/24/2022-12:11:28] [V] [TRT] Tactic: 18 Time: 0.0820137
[11/24/2022-12:11:28] [V] [TRT] Tactic: 19 Time: 0.0906171
[11/24/2022-12:11:29] [V] [TRT] Tactic: 20 Time: 0.0600229
[11/24/2022-12:11:29] [V] [TRT] Tactic: 21 Time: 0.0600137
[11/24/2022-12:11:29] [V] [TRT] Tactic: 22 Time: 0.0600259
[11/24/2022-12:11:30] [V] [TRT] Tactic: 23 Time: 0.0615558
[11/24/2022-12:11:30] [V] [TRT] Tactic: 24 Time: 0.0600442
[11/24/2022-12:11:30] [V] [TRT] Tactic: 25 Time: 0.0599893
[11/24/2022-12:11:30] [V] [TRT] Tactic: 26 Time: 0.0600366
[11/24/2022-12:11:31] [V] [TRT] Tactic: 27 Time: 0.0599954
[11/24/2022-12:11:31] [V] [TRT] Tactic: 29 Time: 0.0599832
[11/24/2022-12:11:31] [V] [TRT] Tactic: 30 Time: 0.0600107
[11/24/2022-12:11:32] [V] [TRT] Tactic: 31 Time: 0.0599985
[11/24/2022-12:11:32] [V] [TRT] Fastest Tactic: 10 Time: 0.0286949
[11/24/2022-12:11:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:11:32] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:11:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10
[11/24/2022-12:11:32] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1), Half(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:11:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:32] [V] [TRT] Tactic: 20 Time: 0.0594895
[11/24/2022-12:11:32] [V] [TRT] Tactic: 21 Time: 0.0600381
[11/24/2022-12:11:33] [V] [TRT] Tactic: 22 Time: 0.0600168
[11/24/2022-12:11:33] [V] [TRT] Tactic: 23 Time: 0.0710126
[11/24/2022-12:11:33] [V] [TRT] Tactic: 24 Time: 0.0596053
[11/24/2022-12:11:34] [V] [TRT] Tactic: 25 Time: 0.0599954
[11/24/2022-12:11:34] [V] [TRT] Tactic: 26 Time: 0.0600701
[11/24/2022-12:11:34] [V] [TRT] Tactic: 27 Time: 0.0616427
[11/24/2022-12:11:34] [V] [TRT] Tactic: 30 Time: 0.0569524
[11/24/2022-12:11:35] [V] [TRT] Tactic: 31 Time: 0.0595749
[11/24/2022-12:11:35] [V] [TRT] Fastest Tactic: 30 Time: 0.0569524
[11/24/2022-12:11:35] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:11:35] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:11:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 30
[11/24/2022-12:11:35] [V] [TRT] *************** Autotuning format combination: Half(1:8,924,42,1), Half(1:8,924,42,1) -> Half(1:8,924,42,1) ***************
[11/24/2022-12:11:35] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:35] [V] [TRT] Tactic: 0 Time: 3.1514
[11/24/2022-12:11:35] [V] [TRT] Tactic: 1 Time: 4.45286
[11/24/2022-12:11:36] [V] [TRT] Tactic: 2 Time: 4.2276
[11/24/2022-12:11:36] [V] [TRT] Tactic: 3 Time: 6.68077
[11/24/2022-12:11:37] [V] [TRT] Tactic: 4 Time: 5.76096
[11/24/2022-12:11:37] [V] [TRT] Tactic: 5 Time: 4.16411
[11/24/2022-12:11:37] [V] [TRT] Tactic: 6 Time: 11.1426
[11/24/2022-12:11:38] [V] [TRT] Tactic: 7 Time: 7.44682
[11/24/2022-12:11:38] [V] [TRT] Tactic: 8 Time: 8.30427
[11/24/2022-12:11:39] [V] [TRT] Tactic: 9 Time: 6.30368
[11/24/2022-12:11:39] [V] [TRT] Tactic: 10 Time: 2.51182
[11/24/2022-12:11:40] [V] [TRT] Tactic: 11 Time: 3.33321
[11/24/2022-12:11:40] [V] [TRT] Tactic: 12 Time: 3.056
[11/24/2022-12:11:40] [V] [TRT] Tactic: 13 Time: 4.58856
[11/24/2022-12:11:41] [V] [TRT] Tactic: 14 Time: 4.27356
[11/24/2022-12:11:41] [V] [TRT] Tactic: 15 Time: 2.98016
[11/24/2022-12:11:41] [V] [TRT] Tactic: 16 Time: 5.86555
[11/24/2022-12:11:42] [V] [TRT] Tactic: 17 Time: 2.92299
[11/24/2022-12:11:42] [V] [TRT] Tactic: 18 Time: 2.60387
[11/24/2022-12:11:43] [V] [TRT] Tactic: 19 Time: 1.90288
[11/24/2022-12:11:43] [V] [TRT] Tactic: 20 Time: 1.07195
[11/24/2022-12:11:43] [V] [TRT] Tactic: 21 Time: 1.50421
[11/24/2022-12:11:44] [V] [TRT] Tactic: 22 Time: 2.04337
[11/24/2022-12:11:44] [V] [TRT] Tactic: 23 Time: 3.13134
[11/24/2022-12:11:44] [V] [TRT] Tactic: 24 Time: 0.925998
[11/24/2022-12:11:44] [V] [TRT] Tactic: 25 Time: 1.29591
[11/24/2022-12:11:45] [V] [TRT] Tactic: 26 Time: 1.72436
[11/24/2022-12:11:45] [V] [TRT] Tactic: 27 Time: 2.59752
[11/24/2022-12:11:45] [V] [TRT] Tactic: 28 Time: 0.164155
[11/24/2022-12:11:46] [V] [TRT] Tactic: 29 Time: 0.150208
[11/24/2022-12:11:46] [V] [TRT] Tactic: 30 Time: 0.15915
[11/24/2022-12:11:46] [V] [TRT] Tactic: 31 Time: 0.240261
[11/24/2022-12:11:46] [V] [TRT] Fastest Tactic: 29 Time: 0.150208
[11/24/2022-12:11:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29
[11/24/2022-12:11:46] [V] [TRT] *************** Autotuning format combination: Half(88704:32,924,42,1), Half(88704:32,924,42,1) -> Half(88704:32,924,42,1) ***************
[11/24/2022-12:11:46] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:47] [V] [TRT] Tactic: 20 Time: 0.59056
[11/24/2022-12:11:47] [V] [TRT] Tactic: 21 Time: 0.682702
[11/24/2022-12:11:47] [V] [TRT] Tactic: 22 Time: 0.690926
[11/24/2022-12:11:48] [V] [TRT] Tactic: 23 Time: 0.697207
[11/24/2022-12:11:48] [V] [TRT] Tactic: 24 Time: 0.586016
[11/24/2022-12:11:48] [V] [TRT] Tactic: 25 Time: 0.586953
[11/24/2022-12:11:49] [V] [TRT] Tactic: 26 Time: 0.587694
[11/24/2022-12:11:49] [V] [TRT] Tactic: 27 Time: 0.592878
[11/24/2022-12:11:49] [V] [TRT] Tactic: 30 Time: 0.591163
[11/24/2022-12:11:50] [V] [TRT] Tactic: 31 Time: 0.586126
[11/24/2022-12:11:50] [V] [TRT] Fastest Tactic: 24 Time: 0.586016
[11/24/2022-12:11:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24
[11/24/2022-12:11:50] [V] [TRT] *************** Autotuning format combination: Int8(88704,924,42,1), Int8(88704,924,42,1) -> Int8(88704,924,42,1) ***************
[11/24/2022-12:11:50] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:50] [V] [TRT] Tactic: 0 Time: 0.0411611
[11/24/2022-12:11:50] [V] [TRT] Tactic: 1 Time: 0.0351369
[11/24/2022-12:11:51] [V] [TRT] Tactic: 2 Time: 0.0348407
[11/24/2022-12:11:51] [V] [TRT] Tactic: 3 Time: 0.0348151
[11/24/2022-12:11:51] [V] [TRT] Tactic: 4 Time: 0.0293504
[11/24/2022-12:11:51] [V] [TRT] Tactic: 5 Time: 0.0286053
[11/24/2022-12:11:52] [V] [TRT] Tactic: 6 Time: 0.0347831
[11/24/2022-12:11:52] [V] [TRT] Tactic: 7 Time: 0.0293495
[11/24/2022-12:11:52] [V] [TRT] Tactic: 8 Time: 0.0285082
[11/24/2022-12:11:53] [V] [TRT] Tactic: 9 Time: 0.028917
[11/24/2022-12:11:53] [V] [TRT] Tactic: 28 Time: 0.0406171
[11/24/2022-12:11:53] [V] [TRT] Fastest Tactic: 8 Time: 0.0285082
[11/24/2022-12:11:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
[11/24/2022-12:11:53] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1), Int8(22176,924:4,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:11:53] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:11:53] [V] [TRT] Tactic: 0 Time: 0.0284389
[11/24/2022-12:11:54] [V] [TRT] Tactic: 1 Time: 0.0285742
[11/24/2022-12:11:54] [V] [TRT] Tactic: 2 Time: 0.0286162
[11/24/2022-12:11:54] [V] [TRT] Tactic: 3 Time: 0.0340763
[11/24/2022-12:11:55] [V] [TRT] Tactic: 4 Time: 0.0346935
[11/24/2022-12:11:55] [V] [TRT] Tactic: 5 Time: 0.0347721
[11/24/2022-12:11:55] [V] [TRT] Tactic: 6 Time: 0.0411257
[11/24/2022-12:11:56] [V] [TRT] Tactic: 7 Time: 0.0411829
[11/24/2022-12:11:56] [V] [TRT] Tactic: 8 Time: 0.0411314
[11/24/2022-12:11:56] [V] [TRT] Tactic: 9 Time: 0.0419634
[11/24/2022-12:11:57] [V] [TRT] Tactic: 10 Time: 0.0349678
[11/24/2022-12:11:57] [V] [TRT] Tactic: 11 Time: 0.0348187
[11/24/2022-12:11:57] [V] [TRT] Tactic: 12 Time: 0.034763
[11/24/2022-12:11:58] [V] [TRT] Tactic: 13 Time: 0.0347922
[11/24/2022-12:11:58] [V] [TRT] Tactic: 14 Time: 0.0348379
[11/24/2022-12:11:58] [V] [TRT] Tactic: 15 Time: 0.0348242
[11/24/2022-12:11:59] [V] [TRT] Tactic: 16 Time: 0.040696
[11/24/2022-12:11:59] [V] [TRT] Tactic: 17 Time: 0.0358731
[11/24/2022-12:11:59] [V] [TRT] Tactic: 18 Time: 0.0411189
[11/24/2022-12:12:00] [V] [TRT] Tactic: 19 Time: 0.0411291
[11/24/2022-12:12:00] [V] [TRT] Tactic: 20 Time: 0.0474229
[11/24/2022-12:12:00] [V] [TRT] Tactic: 21 Time: 0.0411291
[11/24/2022-12:12:01] [V] [TRT] Tactic: 22 Time: 0.0348654
[11/24/2022-12:12:01] [V] [TRT] Tactic: 23 Time: 0.0348846
[11/24/2022-12:12:01] [V] [TRT] Tactic: 28 Time: 0.0356791
[11/24/2022-12:12:02] [V] [TRT] Tactic: 29 Time: 0.0411349
[11/24/2022-12:12:02] [V] [TRT] Tactic: 30 Time: 0.0420469
[11/24/2022-12:12:02] [V] [TRT] Fastest Tactic: 0 Time: 0.0284389
[11/24/2022-12:12:02] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:12:02] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0
[11/24/2022-12:12:02] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1), Int8(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:12:02] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:12:02] [V] [TRT] Tactic: 10 Time: 0.0286324
[11/24/2022-12:12:03] [V] [TRT] Tactic: 11 Time: 0.0356937
[11/24/2022-12:12:03] [V] [TRT] Tactic: 12 Time: 0.0347758
[11/24/2022-12:12:03] [V] [TRT] Tactic: 13 Time: 0.0537524
[11/24/2022-12:12:04] [V] [TRT] Tactic: 14 Time: 0.0411326
[11/24/2022-12:12:04] [V] [TRT] Tactic: 15 Time: 0.0474846
[11/24/2022-12:12:04] [V] [TRT] Tactic: 16 Time: 0.0854926
[11/24/2022-12:12:05] [V] [TRT] Tactic: 17 Time: 0.0664366
[11/24/2022-12:12:05] [V] [TRT] Tactic: 18 Time: 0.0727223
[11/24/2022-12:12:06] [V] [TRT] Tactic: 19 Time: 0.0787383
[11/24/2022-12:12:06] [V] [TRT] Tactic: 20 Time: 0.0284602
[11/24/2022-12:12:07] [V] [TRT] Tactic: 21 Time: 0.0293312
[11/24/2022-12:12:07] [V] [TRT] Tactic: 22 Time: 0.0407371
[11/24/2022-12:12:07] [V] [TRT] Tactic: 23 Time: 0.0537783
[11/24/2022-12:12:08] [V] [TRT] Tactic: 24 Time: 0.0286437
[11/24/2022-12:12:08] [V] [TRT] Tactic: 25 Time: 0.028483
[11/24/2022-12:12:08] [V] [TRT] Tactic: 26 Time: 0.0293623
[11/24/2022-12:12:09] [V] [TRT] Tactic: 27 Time: 0.0411291
[11/24/2022-12:12:09] [V] [TRT] Tactic: 29 Time: 0.110752
[11/24/2022-12:12:09] [V] [TRT] Tactic: 30 Time: 0.0664168
[11/24/2022-12:12:10] [V] [TRT] Tactic: 31 Time: 0.0474651
[11/24/2022-12:12:10] [V] [TRT] Fastest Tactic: 20 Time: 0.0284602
[11/24/2022-12:12:10] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWise)
[11/24/2022-12:12:10] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20
[11/24/2022-12:12:10] [V] [TRT] *************** Autotuning format combination: Int8(88704:32,924,42,1), Int8(88704:32,924,42,1) -> Int8(88704:32,924,42,1) ***************
[11/24/2022-12:12:10] [V] [TRT] --------------- Timing Runner: PWN(node_of_661) (PointWiseV2)
[11/24/2022-12:12:10] [V] [TRT] Tactic: 10 Time: 0.333925
[11/24/2022-12:12:10] [V] [TRT] Tactic: 11 Time: 0.600891
[11/24/2022-12:12:11] [V] [TRT] Tactic: 12 Time: 0.657902
[11/24/2022-12:12:11] [V] [TRT] Tactic: 13 Time: 0.611538
[11/24/2022-12:12:12] [V] [TRT] Tactic: 14 Time: 0.615049
[11/24/2022-12:12:12] [V] [TRT] Tactic: 15 Time: 0.710578
[11/24/2022-12:12:13] [V] [TRT] Tactic: 16 Time: 0.640827
[11/24/2022-12:12:13] [V] [TRT] Tactic: 17 Time: 0.620718
[11/24/2022-12:12:14] [V] [TRT] Tactic: 18 Time: 0.747904
[11/24/2022-12:12:14] [V] [TRT] Tactic: 19 Time: 0.942542
[11/24/2022-12:12:15] [V] [TRT] Tactic: 20 Time: 0.718784
[11/24/2022-12:12:15] [V] [TRT] Tactic: 21 Time: 0.715278
[11/24/2022-12:12:15] [V] [TRT] Tactic: 22 Time: 0.72277
[11/24/2022-12:12:16] [V] [TRT] Tactic: 23 Time: 0.747168
[11/24/2022-12:12:16] [V] [TRT] Tactic: 24 Time: 0.84805
[11/24/2022-12:12:16] [V] [TRT] Tactic: 25 Time: 0.647031
[11/24/2022-12:12:17] [V] [TRT] Tactic: 26 Time: 0.625865
[11/24/2022-12:12:17] [V] [TRT] Tactic: 27 Time: 0.632439
[11/24/2022-12:12:17] [V] [TRT] Tactic: 29 Time: 5.03368
[11/24/2022-12:12:18] [V] [TRT] Tactic: 30 Time: 2.67707
[11/24/2022-12:12:18] [V] [TRT] Tactic: 31 Time: 1.58662
[11/24/2022-12:12:18] [V] [TRT] Fastest Tactic: 10 Time: 0.333925
[11/24/2022-12:12:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 10
[11/24/2022-12:12:18] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:18] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:12:18] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudaDepthwiseConvolution)
[11/24/2022-12:12:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:18] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (FusedConvActConvolution)
[11/24/2022-12:12:18] [V] [TRT] Tactic: 589823 Time: 0.544686
[11/24/2022-12:12:18] [V] [TRT] Tactic: 655359 Time: 0.443744
[11/24/2022-12:12:18] [V] [TRT] Tactic: 786431 Time: 0.406158
[11/24/2022-12:12:18] [V] [TRT] Tactic: 851967 Time: 0.384251
[11/24/2022-12:12:18] [V] [TRT] Tactic: 1179647 Time: 0.422245
[11/24/2022-12:12:18] [V] [TRT] Tactic: 1638399 Time: 0.40448
[11/24/2022-12:12:18] [V] [TRT] Tactic: 2097151 Time: 0.406286
[11/24/2022-12:12:18] [V] [TRT] Tactic: 3538943 Time: 0.404837
[11/24/2022-12:12:18] [V] [TRT] Tactic: 3932159 Time: 0.423461
[11/24/2022-12:12:18] [V] [TRT] Tactic: 3997695 Time: 0.404457
[11/24/2022-12:12:18] [V] [TRT] Tactic: 4194303 Time: 0.379461
[11/24/2022-12:12:18] [V] [TRT] Tactic: 4259839 Time: 0.40789
[11/24/2022-12:12:18] [V] [TRT] Tactic: 4587519 Time: 0.399845
[11/24/2022-12:12:18] [V] [TRT] Tactic: 4653055 Time: 0.403433
[11/24/2022-12:12:18] [V] [TRT] Tactic: 4915199 Time: 0.401257
[11/24/2022-12:12:18] [V] [TRT] Tactic: 4980735 Time: 0.380955
[11/24/2022-12:12:18] [V] [TRT] Tactic: 5177343 Time: 0.429961
[11/24/2022-12:12:18] [V] [TRT] Tactic: 5242879 Time: 0.368334
[11/24/2022-12:12:18] [V] [TRT] Tactic: 5373951 Time: 0.479689
[11/24/2022-12:12:18] [V] [TRT] Tactic: 5570559 Time: 0.368411
[11/24/2022-12:12:18] [V] [TRT] Tactic: 5767167 Time: 0.578304
[11/24/2022-12:12:18] [V] [TRT] Tactic: 5898239 Time: 0.389751
[11/24/2022-12:12:18] [V] [TRT] Tactic: 6225919 Time: 0.425906
[11/24/2022-12:12:18] [V] [TRT] Tactic: 6291455 Time: 0.414825
[11/24/2022-12:12:18] [V] [TRT] Tactic: 6815743 Time: 0.410016
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7012351 Time: 0.405559
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7077887 Time: 0.440178
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7143423 Time: 0.508123
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7208959 Time: 0.383415
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7340031 Time: 0.433595
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7536639 Time: 0.552978
[11/24/2022-12:12:18] [V] [TRT] Tactic: 7733247 Time: 0.408187
[11/24/2022-12:12:18] [V] [TRT] Tactic: 8191999 Time: 0.472928
[11/24/2022-12:12:18] [V] [TRT] Tactic: 8716287 Time: 0.437243
[11/24/2022-12:12:18] [V] [TRT] Tactic: 9109503 Time: 0.447995
[11/24/2022-12:12:18] [V] [TRT] Tactic: 9568255 Time: 0.405317
[11/24/2022-12:12:18] [V] [TRT] Tactic: 10354687 Time: 0.426555
[11/24/2022-12:12:18] [V] [TRT] Tactic: 10747903 Time: 0.369883
[11/24/2022-12:12:18] [V] [TRT] Fastest Tactic: 5242879 Time: 0.368334
[11/24/2022-12:12:18] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudnnConvolution)
[11/24/2022-12:12:18] [V] [TRT] Tactic: 0 Time: 0.376603
[11/24/2022-12:12:18] [V] [TRT] Tactic: 1 Time: 0.370971
[11/24/2022-12:12:18] [V] [TRT] Tactic: 2 Time: 0.763378
[11/24/2022-12:12:19] [V] [TRT] Tactic: 4 Time: 34.8553
[11/24/2022-12:12:19] [V] [TRT] Tactic: 5 Time: 1.26491
[11/24/2022-12:12:19] [V] [TRT] Tactic: 56 Time: 0.379269
[11/24/2022-12:12:19] [V] [TRT] Tactic: 57 Time: 0.373449
[11/24/2022-12:12:19] [V] [TRT] Tactic: 58 Time: 0.761257
[11/24/2022-12:12:19] [V] [TRT] Tactic: 60 Time: 31.1552
[11/24/2022-12:12:19] [V] [TRT] Tactic: 61 Time: 1.31677
[11/24/2022-12:12:19] [V] [TRT] Tactic: 112 Time: 0.377051
[11/24/2022-12:12:19] [V] [TRT] Tactic: 113 Time: 0.378007
[11/24/2022-12:12:19] [V] [TRT] Tactic: 114 Time: 0.760224
[11/24/2022-12:12:19] [V] [TRT] Tactic: 116 Time: 30.998
[11/24/2022-12:12:20] [V] [TRT] Tactic: 117 Time: 1.2633
[11/24/2022-12:12:20] [V] [TRT] Fastest Tactic: 1 Time: 0.370971
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:12:20] [V] [TRT] Tactic: 621442388677115936 Time: 0.160576
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:12:20] [V] [TRT] Tactic: 697756878388249475 Time: 0.204274
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:12:20] [V] [TRT] Tactic: 1159272950022995759 Time: 0.14933
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:12:20] [V] [TRT] Tactic: 1327459216264546184 Time: 0.237595
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:12:20] [V] [TRT] Tactic: 2290218393647758202 Time: 0.193216
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:12:20] [V] [TRT] Tactic: 2310520233542099555 Time: 0.281659
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:12:20] [V] [TRT] Tactic: 3377996665278764661 Time: 0.359991
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4032904638566464623 Time: 0.171945
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4549827808004681195 Time: 0.226213
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4918658762935651592 Time: 0.250217
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5779835512569528575 Time: 0.281349
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5837905844602864231 Time: 0.331922
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6166883504066133838 Time: 0.226373
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6210049212073459059 Time: 0.237883
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6500866402607985231 Time: 0.193472
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6723161876874263939 Time: 0.215392
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6868013466259746979 Time: 0.138601
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6901214267543238617 Time: 0.192571
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:12:20] [V] [TRT] Tactic: 8048119769507926928 Time: 0.253518
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:12:20] [V] [TRT] Tactic: 9151672657204310840 Time: 0.21072
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:12:20] [V] [TRT] Tactic: -8877086111929938764 Time: 0.314569
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:12:20] [V] [TRT] Tactic: -8766093103475083267 Time: 0.193129
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:12:20] [V] [TRT] Tactic: -8198656951359619379 Time: 0.204494
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:12:20] [V] [TRT] Tactic: -7491730084094677098 Time: 0.249349
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:12:20] [V] [TRT] Tactic: -7145578994937510651 Time: 0.193527
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:12:20] [V] [TRT] Tactic: -7070045993088702524 Time: 0.346153
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:12:20] [V] [TRT] Tactic: -6622064180404051845 Time: 0.196443
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:12:20] [V] [TRT] Tactic: -6313876406580483184 Time: 0.259113
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:12:20] [V] [TRT] Tactic: -6273689210331812572 Time: 0.273106
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:12:20] [V] [TRT] Tactic: -4562045946847239058 Time: 0.204663
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:12:20] [V] [TRT] Tactic: -4337126844824617177 Time: 0.227045
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:12:20] [V] [TRT] Tactic: -2777237991111865351 Time: 0.281755
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1918478037390720253 Time: 0.215561
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1349585930542925704 Time: 0.215104
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1123676555321336786 Time: 0.281659
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:12:20] [V] [TRT] Tactic: -701551393537224327 Time: 0.237358
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:12:20] [V] [TRT] Tactic: -3258434593395023 Time: 0.535927
[11/24/2022-12:12:20] [V] [TRT] Fastest Tactic: 6868013466259746979 Time: 0.138601
[11/24/2022-12:12:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6868013466259746979
[11/24/2022-12:12:20] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(88704,1,4032,96) ***************
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:12:20] [V] [TRT] Tactic: 1162498931361159915 Time: 0.182857
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:12:20] [V] [TRT] Tactic: 1663866669559596164 Time: 0.26027
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:12:20] [V] [TRT] Tactic: 2860655430572478466 Time: 0.18357
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:12:20] [V] [TRT] Tactic: 3887292144336338310 Time: 0.182414
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4474630279712975759 Time: 0.204325
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4479823862704990365 Time: 0.203968
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4696204239951173149 Time: 0.185701
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5778138195697110003 Time: 0.270121
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6185707384100198445 Time: 0.182569
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:12:20] [V] [TRT] Tactic: 8918020581761223752 Time: 0.259899
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:12:20] [V] [TRT] Tactic: -8031737312007363273 Time: 0.174455
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:12:20] [V] [TRT] Tactic: -5905193483742532701 Time: 0.171986
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:12:20] [V] [TRT] Tactic: -4896615592193611463 Time: 0.303831
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:12:20] [V] [TRT] Tactic: -4056705536979434560 Time: 0.171296
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:12:20] [V] [TRT] Tactic: -4035591156787122265 Time: 0.195392
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:12:20] [V] [TRT] Tactic: -3071763921328736248 Time: 0.176215
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:12:20] [V] [TRT] Tactic: -2809379259463049391 Time: 0.270738
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1985235291706575900 Time: 0.26053
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:12:20] [V] [TRT] Tactic: -504296718212024303 Time: 0.256128
[11/24/2022-12:12:20] [V] [TRT] Fastest Tactic: -4056705536979434560 Time: 0.171296
[11/24/2022-12:12:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4056705536979434560
[11/24/2022-12:12:20] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(22176,1:4,1008,24) ***************
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:12:20] [V] [TRT] Tactic: 1373022415249282411 Time: 0.127369
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:12:20] [V] [TRT] Tactic: 2536540085349545921 Time: 0.128962
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:12:20] [V] [TRT] Tactic: 3119404851233737725 Time: 0.094816
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5108195418077987197 Time: 0.127595
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5380043773350002416 Time: 0.105657
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5610788582700027969 Time: 0.127522
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6031243482516294286 Time: 0.127531
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6419443404913215692 Time: 0.171538
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6571171993204510025 Time: 0.162002
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:12:20] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0949897
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:12:20] [V] [TRT] Tactic: 7058864664858220889 Time: 0.116601
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:12:20] [V] [TRT] Tactic: -8853476220903838035 Time: 0.149618
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:12:20] [V] [TRT] Tactic: -7067026478815706014 Time: 0.127536
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:12:20] [V] [TRT] Tactic: -6407735577805887428 Time: 0.138677
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:12:20] [V] [TRT] Tactic: -6073218138311523634 Time: 0.182633
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:12:20] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0947977
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:12:20] [V] [TRT] Tactic: -5010594849215755610 Time: 0.117979
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1450865838092804082 Time: 0.17051
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1366318165940453381 Time: 0.160539
[11/24/2022-12:12:20] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:12:20] [V] [TRT] Tactic: -1138876066247138089 Time: 0.105614
[11/24/2022-12:12:20] [V] [TRT] Fastest Tactic: -5033173285090644307 Time: 0.0947977
[11/24/2022-12:12:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5033173285090644307
[11/24/2022-12:12:20] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:12:20] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudnnConvolution)
[11/24/2022-12:12:20] [V] [TRT] Tactic: 0 Time: 0.344229
[11/24/2022-12:12:20] [V] [TRT] Tactic: 1 Time: 0.354359
[11/24/2022-12:12:20] [V] [TRT] Tactic: 2 Time: 0.768046
[11/24/2022-12:12:20] [V] [TRT] Tactic: 4 Time: 30.9683
[11/24/2022-12:12:20] [V] [TRT] Tactic: 5 Time: 1.23193
[11/24/2022-12:12:20] [V] [TRT] Tactic: 56 Time: 0.34245
[11/24/2022-12:12:20] [V] [TRT] Tactic: 58 Time: 0.771355
[11/24/2022-12:12:21] [V] [TRT] Tactic: 60 Time: 30.9551
[11/24/2022-12:12:21] [V] [TRT] Tactic: 61 Time: 1.25566
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: 56 Time: 0.34245
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(88704,924,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(44352,924:2,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (FusedConvActConvolution)
[11/24/2022-12:12:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(88704,924,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(11088,1:8,504,12) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudaDepthwiseConvolution)
[11/24/2022-12:12:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:12:21] [V] [TRT] Tactic: 254850674756030979 Time: 0.138411
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1016009564074305832 Time: 0.138201
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1044128949445110119 Time: 0.105561
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1156328698016730421 Time: 0.127538
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1362727228442059924 Time: 0.10752
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0951909
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1832046141070096030 Time: 0.094512
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0940023
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1877373136269439559 Time: 0.104832
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1899296423087490472 Time: 0.105134
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0952617
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2541579301352125276 Time: 0.105554
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2559328254295148085 Time: 0.116533
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2657157263811141609 Time: 0.137973
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0943909
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3071479995783211391 Time: 0.105714
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0836069
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3362537467505018070 Time: 0.105534
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3513075359009385578 Time: 0.149719
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3704534001553878387 Time: 0.115822
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0836091
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0831406
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4370476717970497892 Time: 0.083664
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0722743
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4491683531415781597 Time: 0.116617
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0922354
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4540505769798915372 Time: 0.116935
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4571819373777460444 Time: 0.139072
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4595173549602041350 Time: 0.11651
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4802447371470387646 Time: 0.116057
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0725349
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5059676457552313631 Time: 0.13821
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5070322914990170527 Time: 0.139143
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0949966
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5346855796032465921 Time: 0.104978
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5398999388616959893 Time: 0.127051
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0831794
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6372404953297521067 Time: 0.138514
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6377497238381488891 Time: 0.105049
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0945349
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0727566
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6724319788728799540 Time: 0.105591
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0942789
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7216571380637776659 Time: 0.116379
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7609923741161019135 Time: 0.08968
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8095507026323593899 Time: 0.105963
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8101703987960976805 Time: 0.105486
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8170606396342855895 Time: 0.094208
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8764780417487154889 Time: 0.117616
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0836297
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8839784824303350101 Time: 0.116066
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:12:21] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0738834
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:12:21] [V] [TRT] Tactic: -9009272790678027912 Time: 0.118199
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8604374562669615024 Time: 0.127289
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8280443484414412687 Time: 0.129792
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8205952393017864204 Time: 0.11669
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0836
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7410012245391920273 Time: 0.127826
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7099920365135295801 Time: 0.07256
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7089118800560870395 Time: 0.117205
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0945943
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6356316196810535311 Time: 0.139785
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0926217
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5530886555766748586 Time: 0.105088
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0836023
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5261787675443473128 Time: 0.116009
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0945691
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0835977
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5109582882231362997 Time: 0.138309
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0836366
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0940983
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0949577
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4379519430184503304 Time: 0.084464
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0951611
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4152066959007262150 Time: 0.137641
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0834606
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0944868
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3905653247016903130 Time: 0.127506
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3903342530518878192 Time: 0.106009
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3864869056275745423 Time: 0.116055
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3601464762214218301 Time: 0.093904
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3234716536615144018 Time: 0.105639
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3200815656917281917 Time: 0.128295
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0942583
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2878731503146438856 Time: 0.094704
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0980777
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2353603993968373338 Time: 0.117138
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0953189
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0842034
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1985778916402815946 Time: 0.116562
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1828674067637788567 Time: 0.105673
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1640527254204634147 Time: 0.095216
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0946834
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1242202084391243207 Time: 0.084176
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1099247066487349374 Time: 0.126446
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0840594
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:12:21] [V] [TRT] Tactic: -406984317033388136 Time: 0.117143
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:12:21] [V] [TRT] Tactic: -331499326992534460 Time: 0.0844914
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:12:21] [V] [TRT] Tactic: -206523504474952360 Time: 0.0945623
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: 4480294673430783793 Time: 0.0722743
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4480294673430783793
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(5544,1:16,252,6) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CublasConvolution)
[11/24/2022-12:12:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudaDepthwiseConvolution)
[11/24/2022-12:12:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1508480131241957639 Time: 0.173797
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2141154648944475104 Time: 0.17189
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3239257003214966313 Time: 0.172635
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5592640619112287921 Time: 0.137719
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7621465827583909090 Time: 0.137714
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6580271968881459581 Time: 0.139118
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5576936487443445631 Time: 0.138281
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4443833619060044580 Time: 0.139214
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2297737319934264721 Time: 0.150171
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1425085658556684465 Time: 0.149527
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:12:21] [V] [TRT] Tactic: -108011214168778087 Time: 0.148974
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:12:21] [V] [TRT] Tactic: -42427192380281294 Time: 0.139419
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: 7621465827583909090 Time: 0.137714
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7621465827583909090
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(22176,924:4,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudaDepthwiseConvolution)
[11/24/2022-12:12:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (FusedConvActConvolution)
[11/24/2022-12:12:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:12:21] [V] [TRT] Tactic: 175853789719975416 Time: 0.116146
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2171150287007712632 Time: 0.116466
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2234457234705232274 Time: 0.104834
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5834048089706882838 Time: 0.106905
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6299962968199310600 Time: 0.139289
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6341572697076960911 Time: 0.106025
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8626990807754934295 Time: 0.116073
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8498217049614706532 Time: 0.10603
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7303593854972602201 Time: 0.106315
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6585664687867083638 Time: 0.138354
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3326139578711341011 Time: 0.107662
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:12:21] [V] [TRT] Tactic: -683636008127039856 Time: 0.137977
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: 2234457234705232274 Time: 0.104834
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2234457234705232274
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1100922622480907544 Time: 0.116146
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2855900226702061782 Time: 0.139134
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3606311198834416176 Time: 0.105369
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4325765560739862899 Time: 0.137936
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8803458114157674373 Time: 0.106105
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6934773036503365000 Time: 0.105929
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4431642509665791294 Time: 0.106041
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4255737803793506479 Time: 0.138359
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3958182351168863467 Time: 0.105072
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3111968753064955248 Time: 0.116411
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1492575840277333548 Time: 0.116501
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:12:21] [V] [TRT] Tactic: -868495160148524802 Time: 0.104914
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: -868495160148524802 Time: 0.104914
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -868495160148524802
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(88704,924,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0994949
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5104832031493112835 Time: 0.105525
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0939931
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: -5287526117701381005 Time: 0.0939931
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5287526117701381005
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(2772,924:32,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2185926646498217601 Time: 0.106423
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0833143
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0721371
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4178917718361232468 Time: 0.10611
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5012796702462679112 Time: 0.138393
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6556170942941957134 Time: 0.105527
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6618077155362058131 Time: 0.072704
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6969462133921577484 Time: 0.11544
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0822057
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7869897696365535632 Time: 0.08312
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0719269
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0833874
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0720114
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8893439100868426414 Time: 0.116075
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8069335661823714580 Time: 0.149056
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7988637803896331454 Time: 0.104949
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7957004747664952265 Time: 0.10504
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7904635102498369361 Time: 0.136523
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0829211
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7606074703023778034 Time: 0.105093
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7282232519526877434 Time: 0.138007
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0721006
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0831269
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5603587790314027122 Time: 0.114962
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5416590980288859834 Time: 0.106251
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:12:21] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0939863
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3665201838779845683 Time: 0.150551
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3644377136375731441 Time: 0.106592
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0831223
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0940206
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1610768292520086910 Time: 0.115648
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:12:21] [V] [TRT] Tactic: -621838502160440068 Time: 0.116665
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: 7970271430402365872 Time: 0.0719269
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7970271430402365872
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(2772,924:32,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:12:21] [V] [TRT] Tactic: 424230345342282109 Time: 0.116455
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0721349
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2327398338581585326 Time: 0.105381
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0721463
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4549109251242445288 Time: 0.138343
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0721189
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7107586691882206281 Time: 0.104974
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7178538052023824067 Time: 0.105177
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0831177
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7515859573761964679 Time: 0.138002
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0608472
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0609889
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0720434
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0721737
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8471142395703548718 Time: 0.060829
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:12:21] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0721074
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0720731
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0614629
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:12:21] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0629943
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:12:21] [V] [TRT] Tactic: -7272221766465547628 Time: 0.106523
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6733478368603461850 Time: 0.107195
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0939109
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:12:21] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0940663
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5817829912551792981 Time: 0.106046
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:12:21] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0722491
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0715947
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3556614738549917282 Time: 0.106359
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:12:21] [V] [TRT] Tactic: -3514726588976755320 Time: 0.094032
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:12:21] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0721623
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1712174008006584201 Time: 0.127735
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:12:21] [V] [TRT] Tactic: -1008204680238783384 Time: 0.104946
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:12:21] [V] [TRT] Tactic: -50323486981480818 Time: 0.105874
[11/24/2022-12:12:21] [V] [TRT] Fastest Tactic: 8471142395703548718 Time: 0.060829
[11/24/2022-12:12:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8471142395703548718
[11/24/2022-12:12:21] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(2772,924:32,42,1) ***************
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudaGroupConvolution)
[11/24/2022-12:12:21] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CudaDepthwiseConvolution)
[11/24/2022-12:12:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (FusedConvActConvolution)
[11/24/2022-12:12:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:21] [V] [TRT] --------------- Timing Runner: node_of_662 + node_of_663 + node_of_664 (CaskConvolution)
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:12:21] [V] [TRT] Tactic: 125145153013230687 Time: 0.0847977
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0720549
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0722217
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:12:21] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0613699
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:12:21] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0609493
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0608533
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0720366
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:12:21] [V] [TRT] Tactic: 3593397928177382100 Time: 0.072144
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0721326
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0611322
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:12:21] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0710095
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0722309
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0651733
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0720937
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:12:21] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0720114
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0844137
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0720183
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0832069
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0720366
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0829966
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0608503
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0723817
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0729874
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:12:21] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0718811
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:12:21] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0722217
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0940251
[11/24/2022-12:12:21] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:12:21] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0940846
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8234775147403903473 Time: 0.104962
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0625219
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0721486
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:12:22] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0610316
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:12:22] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0615223
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0721646
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0710232
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0831451
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:12:22] [V] [TRT] Tactic: -5671123121710113970 Time: 0.072032
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:12:22] [V] [TRT] Tactic: -5562968047117507056 Time: 0.083152
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:12:22] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0608564
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0608518
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4425346730823666456 Time: 0.104985
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0724663
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0844891
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:12:22] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0608853
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:12:22] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0721486
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:12:22] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0828206
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:12:22] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0721394
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:12:22] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0720686
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:12:22] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0947086
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0719749
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0868137
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0720343
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0611413
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:12:22] [V] [TRT] Tactic: -405554772060757402 Time: 0.0720526
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:12:22] [V] [TRT] Tactic: -375949437730908730 Time: 0.0694933
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:12:22] [V] [TRT] Tactic: -111878368089469751 Time: 0.104978
[11/24/2022-12:12:22] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:12:22] [V] [TRT] Tactic: -19707840769375107 Time: 0.0609478
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: 6457435868048963632 Time: 0.0608503
[11/24/2022-12:12:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6457435868048963632
[11/24/2022-12:12:22] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudaDepthwiseConvolution)
[11/24/2022-12:12:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (FusedConvActConvolution)
[11/24/2022-12:12:22] [V] [TRT] Tactic: 589823 Time: 0.390304
[11/24/2022-12:12:22] [V] [TRT] Tactic: 655359 Time: 0.291515
[11/24/2022-12:12:22] [V] [TRT] Tactic: 786431 Time: 0.170423
[11/24/2022-12:12:22] [V] [TRT] Tactic: 851967 Time: 0.247278
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1179647 Time: 0.186144
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1638399 Time: 0.170642
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2097151 Time: 0.167493
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3538943 Time: 0.167301
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3932159 Time: 0.262171
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3997695 Time: 0.162967
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4194303 Time: 0.181728
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4259839 Time: 0.159483
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4587519 Time: 0.159895
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4653055 Time: 0.198647
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4915199 Time: 0.159461
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4980735 Time: 0.204818
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5177343 Time: 0.198757
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5242879 Time: 0.181591
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5373951 Time: 0.206693
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5570559 Time: 0.214277
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5767167 Time: 0.230441
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5898239 Time: 0.195899
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6225919 Time: 0.170482
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6291455 Time: 0.184987
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6815743 Time: 0.192521
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7012351 Time: 0.165682
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7077887 Time: 0.175195
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7143423 Time: 0.19387
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7208959 Time: 0.19248
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7340031 Time: 0.20805
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7536639 Time: 0.253605
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7733247 Time: 0.170565
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8191999 Time: 0.175145
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8716287 Time: 0.192507
[11/24/2022-12:12:22] [V] [TRT] Tactic: 9109503 Time: 0.184549
[11/24/2022-12:12:22] [V] [TRT] Tactic: 9568255 Time: 0.161056
[11/24/2022-12:12:22] [V] [TRT] Tactic: 10354687 Time: 0.184544
[11/24/2022-12:12:22] [V] [TRT] Tactic: 10747903 Time: 0.170487
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: 4915199 Time: 0.159461
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudnnConvolution)
[11/24/2022-12:12:22] [V] [TRT] Tactic: 0 Time: 0.232704
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1 Time: 0.233138
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2 Time: 1.11722
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4 Time: 4.73099
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5 Time: 0.135442
[11/24/2022-12:12:22] [V] [TRT] Tactic: 56 Time: 0.0508511
[11/24/2022-12:12:22] [V] [TRT] Tactic: 57 Time: 0.0594331
[11/24/2022-12:12:22] [V] [TRT] Tactic: 58 Time: 0.215913
[11/24/2022-12:12:22] [V] [TRT] Tactic: 60 Time: 2.17442
[11/24/2022-12:12:22] [V] [TRT] Tactic: 61 Time: 0.128738
[11/24/2022-12:12:22] [V] [TRT] Tactic: 112 Time: 0.052221
[11/24/2022-12:12:22] [V] [TRT] Tactic: 113 Time: 0.0514118
[11/24/2022-12:12:22] [V] [TRT] Tactic: 114 Time: 0.218149
[11/24/2022-12:12:22] [V] [TRT] Tactic: 116 Time: 2.46448
[11/24/2022-12:12:22] [V] [TRT] Tactic: 117 Time: 0.131067
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: 56 Time: 0.0508511
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:12:22] [V] [TRT] Tactic: 621442388677115936 Time: 0.0365806
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:12:22] [V] [TRT] Tactic: 697756878388249475 Time: 0.0215125
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0364766
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0251406
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0302071
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0631649
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0820846
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0402171
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4549827808004681195 Time: 0.051549
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0591954
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0624381
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0738057
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0513524
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0547474
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6500866402607985231 Time: 0.043728
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0475223
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0324763
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0274872
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8048119769507926928 Time: 0.05728
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:12:22] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0473931
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:12:22] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0693455
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:12:22] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0289006
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:12:22] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0462229
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:12:22] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0556678
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:12:22] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0437829
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:12:22] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0766971
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0437211
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0586423
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6273689210331812572 Time: 0.062688
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0458629
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0513067
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:12:22] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0625036
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0475371
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0288841
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0629166
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:12:22] [V] [TRT] Tactic: -701551393537224327 Time: 0.0544091
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:12:22] [V] [TRT] Tactic: -3258434593395023 Time: 0.117577
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: 697756878388249475 Time: 0.0215125
[11/24/2022-12:12:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 697756878388249475
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0401829
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0589531
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0433474
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0408926
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0325531
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0324297
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0436811
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0585996
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0288009
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0587246
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:12:22] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0286766
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:12:22] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0401691
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0664259
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0399474
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:12:22] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0324069
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:12:22] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0400126
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:12:22] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0586743
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0580998
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:12:22] [V] [TRT] Tactic: -504296718212024303 Time: 0.0560122
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: -8031737312007363273 Time: 0.0286766
[11/24/2022-12:12:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8031737312007363273
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0288475
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0287973
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0211285
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0205838
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0245813
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0283505
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0287214
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0390469
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0375509
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0214165
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0252145
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:12:22] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0176244
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:12:22] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0286546
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0210501
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:12:22] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0399817
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:12:22] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0209861
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:12:22] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0286866
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1450865838092804082 Time: 0.039696
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1366318165940453381 Time: 0.02024
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:12:22] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0232588
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: -8853476220903838035 Time: 0.0176244
[11/24/2022-12:12:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8853476220903838035
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudnnConvolution)
[11/24/2022-12:12:22] [V] [TRT] Tactic: 0 Time: 0.0579032
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1 Time: 0.061091
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2 Time: 0.160704
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4 Time: 2.41332
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5 Time: 0.129659
[11/24/2022-12:12:22] [V] [TRT] Tactic: 56 Time: 0.0582735
[11/24/2022-12:12:22] [V] [TRT] Tactic: 58 Time: 0.161797
[11/24/2022-12:12:22] [V] [TRT] Tactic: 60 Time: 2.41417
[11/24/2022-12:12:22] [V] [TRT] Tactic: 61 Time: 0.127922
[11/24/2022-12:12:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0579032
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (FusedConvActConvolution)
[11/24/2022-12:12:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudaDepthwiseConvolution)
[11/24/2022-12:12:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:22] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:12:22] [V] [TRT] Tactic: 254850674756030979 Time: 0.0322953
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0323255
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1044128949445110119 Time: 0.025053
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0287323
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0251436
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0217306
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0214942
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0213682
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0249402
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:12:22] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0206478
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2238656696610018305 Time: 0.02147
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0250507
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0266309
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0209607
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:12:22] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0214028
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0166019
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0206779
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3362537467505018070 Time: 0.024973
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0325678
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0284945
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:12:22] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0171103
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0210005
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0177382
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0173669
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0253349
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0209829
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0259825
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0326299
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0262735
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0276792
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:12:22] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0172119
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0321445
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0314917
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0224137
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0248335
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:12:22] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0286345
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0205943
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0324297
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0247109
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0247299
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0171947
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0248884
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:12:22] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0178823
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0283779
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:12:22] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0213107
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0250987
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:12:22] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0213721
[11/24/2022-12:12:22] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0233117
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0285996
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0176833
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0249333
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:12:23] [V] [TRT] Tactic: -9203179519031456182 Time: 0.0154702
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:12:23] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0283764
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8604374562669615024 Time: 0.02061
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0293349
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0265669
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0205518
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0207562
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0172211
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0174263
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0212415
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0211742
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0210331
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0246766
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0167426
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5261787675443473128 Time: 0.024931
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0213296
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0209378
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0323383
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0170926
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0215216
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0190863
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0190017
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0158903
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0273097
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4021926646879732549 Time: 0.017315
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0198686
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0256244
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0226834
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0229675
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0160772
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3234716536615144018 Time: 0.019672
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0265775
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0194966
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0194303
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2602982885923184927 Time: 0.01996
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0233607
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2032577876140256150 Time: 0.019488
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2003055242756584050 Time: 0.016222
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0233541
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0129455
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0192331
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0194069
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0163566
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0157833
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0166156
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:12:23] [V] [TRT] Tactic: -406984317033388136 Time: 0.0229943
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:12:23] [V] [TRT] Tactic: -331499326992534460 Time: 0.0161869
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:12:23] [V] [TRT] Tactic: -206523504474952360 Time: 0.0193314
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: -1828674067637788567 Time: 0.0129455
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1828674067637788567
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CublasConvolution)
[11/24/2022-12:12:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudaDepthwiseConvolution)
[11/24/2022-12:12:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1508480131241957639 Time: 0.033269
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0336722
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0335927
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5592640619112287921 Time: 0.026656
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0265097
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0266712
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0266446
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4443833619060044580 Time: 0.026736
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0297234
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0288155
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:12:23] [V] [TRT] Tactic: -108011214168778087 Time: 0.0282255
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:12:23] [V] [TRT] Tactic: -42427192380281294 Time: 0.0265265
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 7621465827583909090 Time: 0.0265097
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7621465827583909090
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudaDepthwiseConvolution)
[11/24/2022-12:12:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (FusedConvActConvolution)
[11/24/2022-12:12:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:12:23] [V] [TRT] Tactic: 175853789719975416 Time: 0.0229753
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0230158
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0227487
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0227853
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6299962968199310600 Time: 0.026531
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0226083
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0229642
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8498217049614706532 Time: 0.020672
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0227755
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0266392
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0231197
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:12:23] [V] [TRT] Tactic: -683636008127039856 Time: 0.0266339
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: -8498217049614706532 Time: 0.020672
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8498217049614706532
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1100922622480907544 Time: 0.022865
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2855900226702061782 Time: 0.026573
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0224947
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:12:23] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0265173
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0198303
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6934773036503365000 Time: 0.022784
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0206942
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0265455
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0225561
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0227383
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1492575840277333548 Time: 0.022961
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:12:23] [V] [TRT] Tactic: -868495160148524802 Time: 0.0209881
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0198303
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0158391
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0199617
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0158877
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0158391
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(924,924:32,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0186297
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0125764
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0121665
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:12:23] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0207236
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0262849
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0204434
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6618077155362058131 Time: 0.012368
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0192349
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7348718297764976805 Time: 0.012501
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0124838
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0123577
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0125429
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0125349
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0191697
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0195246
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0197246
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0190503
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7904635102498369361 Time: 0.026419
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0121768
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0226873
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0262484
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0120465
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0122415
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5603587790314027122 Time: 0.022767
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0199189
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0152343
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0222733
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0226096
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0125173
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0157358
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0228199
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:12:23] [V] [TRT] Tactic: -621838502160440068 Time: 0.022959
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.0120465
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:12:23] [V] [TRT] Tactic: 424230345342282109 Time: 0.0227389
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2088124366723311762 Time: 0.0154912
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0208627
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2881044142075831475 Time: 0.012288
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:12:23] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0262636
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0123665
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0196611
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0198263
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0160762
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0264541
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0127139
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0125467
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0156334
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0119798
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0123158
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:12:23] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0122141
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8897233019398469012 Time: 0.0152869
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0118811
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8206171403568243244 Time: 0.012264
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0229055
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0226913
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0193634
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0192326
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0202983
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0122183
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0126091
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0199606
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0194589
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0120503
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0264046
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0220408
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:12:23] [V] [TRT] Tactic: -50323486981480818 Time: 0.0213897
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.0118811
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudaGroupConvolution)
[11/24/2022-12:12:23] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CudaDepthwiseConvolution)
[11/24/2022-12:12:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (FusedConvActConvolution)
[11/24/2022-12:12:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_665 + node_of_666 + node_of_667 (CaskConvolution)
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:12:23] [V] [TRT] Tactic: 125145153013230687 Time: 0.0188926
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0155794
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0155401
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0123051
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2756291002030759362 Time: 0.012347
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0123432
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3538565962642681625 Time: 0.012248
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0123531
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:12:23] [V] [TRT] Tactic: 4112572034735311841 Time: 0.0120556
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:12:23] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0127448
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:12:23] [V] [TRT] Tactic: 4796956614760326119 Time: 0.0141847
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0121878
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0131001
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0157723
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:12:23] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0156581
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0189383
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0156837
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0161128
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0122823
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0164983
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0126236
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0156613
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6925201228918187099 Time: 0.015787
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:12:23] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0159517
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:12:23] [V] [TRT] Tactic: 7318929579222925725 Time: 0.015381
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0191931
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0193286
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8234775147403903473 Time: 0.01982
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8524082966802584889 Time: 0.012939
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:12:23] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0152206
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:12:23] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0127219
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:12:23] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0127139
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0151232
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0121253
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:12:23] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0161981
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0145157
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0161986
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0127025
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0120293
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0197783
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0156571
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:12:23] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0189674
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0120099
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0121703
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:12:23] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0163241
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0153426
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0146272
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:12:23] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0194377
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1916483171117495388 Time: 0.015653
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0189337
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0155584
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:12:23] [V] [TRT] Tactic: -1006589727652607355 Time: 0.012104
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:12:23] [V] [TRT] Tactic: -405554772060757402 Time: 0.0127832
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:12:23] [V] [TRT] Tactic: -375949437730908730 Time: 0.0127078
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:12:23] [V] [TRT] Tactic: -111878368089469751 Time: 0.0197246
[11/24/2022-12:12:23] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:12:23] [V] [TRT] Tactic: -19707840769375107 Time: 0.0127558
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: -3825889760337461729 Time: 0.0120099
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3825889760337461729
[11/24/2022-12:12:23] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Float(29568,924,42,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] Tactic: 0 Time: 0.0888069
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1 Time: 0.0892137
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3 Time: 6.07872
[11/24/2022-12:12:23] [V] [TRT] Tactic: 24 Time: 0.460663
[11/24/2022-12:12:23] [V] [TRT] Tactic: 25 Time: 0.458725
[11/24/2022-12:12:23] [V] [TRT] Tactic: 27 Time: 4.51472
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0888069
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] Tactic: 0 Time: 0.813797
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 0 Time: 0.813797
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:23] [V] [TRT] node_of_668 Set Tactic Name: sm50_xmma_deconv_generic_f32f32_f32_f32_nchwkcrs_nchw Tactic: 1108745107350470483
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Float(29568,1,1344,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:23] [V] [TRT] node_of_668 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 1461874880923808087
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1461874880923808087 Time: 1.34598
[11/24/2022-12:12:23] [V] [TRT] node_of_668 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x128x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2647374945310797548
[11/24/2022-12:12:23] [V] [TRT] Tactic: 2647374945310797548 Time: 3.49214
[11/24/2022-12:12:23] [V] [TRT] node_of_668 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -5631711556980973584
[11/24/2022-12:12:23] [V] [TRT] Tactic: -5631711556980973584 Time: 3.75442
[11/24/2022-12:12:23] [V] [TRT] Fastest Tactic: 1461874880923808087 Time: 1.34598
[11/24/2022-12:12:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskDeconvolutionV2 Tactic: 1461874880923808087
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Float(7392,1:4,336,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:23] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:23] [V] [TRT] *************** Autotuning format combination: Half(29568,924,42,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:23] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:23] [V] [TRT] Tactic: 0 Time: 0.080016
[11/24/2022-12:12:23] [V] [TRT] Tactic: 1 Time: 0.0804297
[11/24/2022-12:12:23] [V] [TRT] Tactic: 3 Time: 5.68858
[11/24/2022-12:12:23] [V] [TRT] Tactic: 24 Time: 0.465435
[11/24/2022-12:12:24] [V] [TRT] Tactic: 27 Time: 4.29479
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 0 Time: 0.080016
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.654258
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 0 Time: 0.654258
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(14784,924:2,42,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(3696,1:8,168,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(1848,1:16,84,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(924,924:32,42,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Int8(7392,924:4,42,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Int8(7392,924:4,42,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CudnnDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (GemmDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolution)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: node_of_668 (CaskDeconvolutionV2)
[11/24/2022-12:12:24] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.0138618
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.011206
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.010996
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.0110748
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.0110333
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.0110516
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.0109996
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.0110038
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.0108774
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.0107478
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.0109417
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 9 Time: 0.0107478
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32), Float(118272,1,2688,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.0110639
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.0107882
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.0104777
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.0105845
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.0103902
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.010574
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.01053
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.0105662
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.0104346
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.0105642
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.0109345
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 4 Time: 0.0103902
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8), Float(29568,1:4,672,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.0143282
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.014097
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.0154322
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.0136864
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.0142117
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.014885
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.0138793
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.0136416
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.0142267
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.0152763
[11/24/2022-12:12:24] [V] [TRT] Tactic: 10 Time: 0.0136673
[11/24/2022-12:12:24] [V] [TRT] Tactic: 11 Time: 0.0139441
[11/24/2022-12:12:24] [V] [TRT] Tactic: 12 Time: 0.0146633
[11/24/2022-12:12:24] [V] [TRT] Tactic: 13 Time: 0.0137276
[11/24/2022-12:12:24] [V] [TRT] Tactic: 14 Time: 0.0137039
[11/24/2022-12:12:24] [V] [TRT] Tactic: 15 Time: 0.0156489
[11/24/2022-12:12:24] [V] [TRT] Tactic: 16 Time: 0.0136815
[11/24/2022-12:12:24] [V] [TRT] Tactic: 17 Time: 0.0135904
[11/24/2022-12:12:24] [V] [TRT] Tactic: 18 Time: 0.0140085
[11/24/2022-12:12:24] [V] [TRT] Tactic: 19 Time: 0.0150793
[11/24/2022-12:12:24] [V] [TRT] Tactic: 20 Time: 0.0132625
[11/24/2022-12:12:24] [V] [TRT] Tactic: 21 Time: 0.0108023
[11/24/2022-12:12:24] [V] [TRT] Tactic: 22 Time: 0.0106093
[11/24/2022-12:12:24] [V] [TRT] Tactic: 23 Time: 0.0104669
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.0142142
[11/24/2022-12:12:24] [V] [TRT] Tactic: 29 Time: 0.0136287
[11/24/2022-12:12:24] [V] [TRT] Tactic: 30 Time: 0.0132825
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 23 Time: 0.0104669
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Float(3696,3696:32,84,1), Float(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 24 Time: 0.0143913
[11/24/2022-12:12:24] [V] [TRT] Tactic: 25 Time: 0.0132156
[11/24/2022-12:12:24] [V] [TRT] Tactic: 26 Time: 0.0129867
[11/24/2022-12:12:24] [V] [TRT] Tactic: 27 Time: 0.0130809
[11/24/2022-12:12:24] [V] [TRT] Tactic: 31 Time: 0.0134275
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 26 Time: 0.0129867
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Float(1:4,3696,84,1), Float(1:4,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.347383
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.432128
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.424471
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.585253
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.609097
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.472535
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.89621
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.816704
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.911127
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.791003
[11/24/2022-12:12:24] [V] [TRT] Tactic: 10 Time: 0.312425
[11/24/2022-12:12:24] [V] [TRT] Tactic: 11 Time: 0.41488
[11/24/2022-12:12:24] [V] [TRT] Tactic: 12 Time: 0.349115
[11/24/2022-12:12:24] [V] [TRT] Tactic: 13 Time: 0.547502
[11/24/2022-12:12:24] [V] [TRT] Tactic: 14 Time: 0.50725
[11/24/2022-12:12:24] [V] [TRT] Tactic: 15 Time: 0.361239
[11/24/2022-12:12:24] [V] [TRT] Tactic: 16 Time: 0.822464
[11/24/2022-12:12:24] [V] [TRT] Tactic: 17 Time: 0.647579
[11/24/2022-12:12:24] [V] [TRT] Tactic: 18 Time: 0.662601
[11/24/2022-12:12:24] [V] [TRT] Tactic: 19 Time: 0.470217
[11/24/2022-12:12:24] [V] [TRT] Tactic: 20 Time: 0.272791
[11/24/2022-12:12:24] [V] [TRT] Tactic: 21 Time: 0.352151
[11/24/2022-12:12:24] [V] [TRT] Tactic: 22 Time: 0.455886
[11/24/2022-12:12:24] [V] [TRT] Tactic: 23 Time: 0.670185
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.0589425
[11/24/2022-12:12:24] [V] [TRT] Tactic: 29 Time: 0.0523215
[11/24/2022-12:12:24] [V] [TRT] Tactic: 30 Time: 0.0541821
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 29 Time: 0.0523215
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1), Half(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.0105202
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.0101114
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.00970606
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.00967863
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.00964754
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.00768914
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.0079218
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.00945543
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.00787609
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.0077375
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.0104963
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 5 Time: 0.00768914
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1), Half(59136,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.0100276
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.00998613
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.00992518
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.0101656
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.0102247
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.0101989
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.0102834
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.0100443
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.0099901
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.0101349
[11/24/2022-12:12:24] [V] [TRT] Tactic: 10 Time: 0.012704
[11/24/2022-12:12:24] [V] [TRT] Tactic: 11 Time: 0.0105241
[11/24/2022-12:12:24] [V] [TRT] Tactic: 12 Time: 0.0102867
[11/24/2022-12:12:24] [V] [TRT] Tactic: 13 Time: 0.0101361
[11/24/2022-12:12:24] [V] [TRT] Tactic: 14 Time: 0.00981364
[11/24/2022-12:12:24] [V] [TRT] Tactic: 15 Time: 0.00975939
[11/24/2022-12:12:24] [V] [TRT] Tactic: 16 Time: 0.00987246
[11/24/2022-12:12:24] [V] [TRT] Tactic: 17 Time: 0.00975421
[11/24/2022-12:12:24] [V] [TRT] Tactic: 18 Time: 0.00972556
[11/24/2022-12:12:24] [V] [TRT] Tactic: 19 Time: 0.0100264
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.0101702
[11/24/2022-12:12:24] [V] [TRT] Tactic: 29 Time: 0.0117306
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 18 Time: 0.00972556
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4), Half(14784,1:8,336,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.0096963
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.0100059
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.00982644
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.0102811
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.0101233
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.0102883
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 0.0104072
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 0.0105793
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 0.0115576
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.0128583
[11/24/2022-12:12:24] [V] [TRT] Tactic: 10 Time: 0.00997333
[11/24/2022-12:12:24] [V] [TRT] Tactic: 11 Time: 0.0100986
[11/24/2022-12:12:24] [V] [TRT] Tactic: 12 Time: 0.00985783
[11/24/2022-12:12:24] [V] [TRT] Tactic: 13 Time: 0.0101093
[11/24/2022-12:12:24] [V] [TRT] Tactic: 14 Time: 0.0100538
[11/24/2022-12:12:24] [V] [TRT] Tactic: 15 Time: 0.00999314
[11/24/2022-12:12:24] [V] [TRT] Tactic: 16 Time: 0.0100861
[11/24/2022-12:12:24] [V] [TRT] Tactic: 17 Time: 0.010399
[11/24/2022-12:12:24] [V] [TRT] Tactic: 18 Time: 0.0102096
[11/24/2022-12:12:24] [V] [TRT] Tactic: 19 Time: 0.0105933
[11/24/2022-12:12:24] [V] [TRT] Tactic: 20 Time: 0.010098
[11/24/2022-12:12:24] [V] [TRT] Tactic: 21 Time: 0.0101925
[11/24/2022-12:12:24] [V] [TRT] Tactic: 22 Time: 0.0102077
[11/24/2022-12:12:24] [V] [TRT] Tactic: 23 Time: 0.0101769
[11/24/2022-12:12:24] [V] [TRT] Tactic: 24 Time: 0.0128396
[11/24/2022-12:12:24] [V] [TRT] Tactic: 25 Time: 0.0104927
[11/24/2022-12:12:24] [V] [TRT] Tactic: 26 Time: 0.0100059
[11/24/2022-12:12:24] [V] [TRT] Tactic: 27 Time: 0.00991665
[11/24/2022-12:12:24] [V] [TRT] Tactic: 28 Time: 0.00984747
[11/24/2022-12:12:24] [V] [TRT] Tactic: 29 Time: 0.00988952
[11/24/2022-12:12:24] [V] [TRT] Tactic: 30 Time: 0.01029
[11/24/2022-12:12:24] [V] [TRT] Tactic: 31 Time: 0.0127832
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0096963
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2), Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 10 Time: 0.00997547
[11/24/2022-12:12:24] [V] [TRT] Tactic: 11 Time: 0.0102531
[11/24/2022-12:12:24] [V] [TRT] Tactic: 12 Time: 0.0097536
[11/24/2022-12:12:24] [V] [TRT] Tactic: 13 Time: 0.0102599
[11/24/2022-12:12:24] [V] [TRT] Tactic: 14 Time: 0.0101769
[11/24/2022-12:12:24] [V] [TRT] Tactic: 15 Time: 0.0103683
[11/24/2022-12:12:24] [V] [TRT] Tactic: 16 Time: 0.01035
[11/24/2022-12:12:24] [V] [TRT] Tactic: 17 Time: 0.0106913
[11/24/2022-12:12:24] [V] [TRT] Tactic: 18 Time: 0.0123931
[11/24/2022-12:12:24] [V] [TRT] Tactic: 19 Time: 0.0129116
[11/24/2022-12:12:24] [V] [TRT] Tactic: 20 Time: 0.0099072
[11/24/2022-12:12:24] [V] [TRT] Tactic: 21 Time: 0.00998034
[11/24/2022-12:12:24] [V] [TRT] Tactic: 22 Time: 0.0101495
[11/24/2022-12:12:24] [V] [TRT] Tactic: 23 Time: 0.0100026
[11/24/2022-12:12:24] [V] [TRT] Tactic: 24 Time: 0.010041
[11/24/2022-12:12:24] [V] [TRT] Tactic: 25 Time: 0.0100504
[11/24/2022-12:12:24] [V] [TRT] Tactic: 26 Time: 0.0100934
[11/24/2022-12:12:24] [V] [TRT] Tactic: 27 Time: 0.0103948
[11/24/2022-12:12:24] [V] [TRT] Tactic: 29 Time: 0.0100849
[11/24/2022-12:12:24] [V] [TRT] Tactic: 30 Time: 0.00976884
[11/24/2022-12:12:24] [V] [TRT] Tactic: 31 Time: 0.0099523
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 12 Time: 0.0097536
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 12
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1), Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 20 Time: 0.00992244
[11/24/2022-12:12:24] [V] [TRT] Tactic: 21 Time: 0.0102051
[11/24/2022-12:12:24] [V] [TRT] Tactic: 22 Time: 0.010206
[11/24/2022-12:12:24] [V] [TRT] Tactic: 23 Time: 0.0103122
[11/24/2022-12:12:24] [V] [TRT] Tactic: 24 Time: 0.00986514
[11/24/2022-12:12:24] [V] [TRT] Tactic: 25 Time: 0.0100169
[11/24/2022-12:12:24] [V] [TRT] Tactic: 26 Time: 0.0102668
[11/24/2022-12:12:24] [V] [TRT] Tactic: 27 Time: 0.0102358
[11/24/2022-12:12:24] [V] [TRT] Tactic: 30 Time: 0.00998339
[11/24/2022-12:12:24] [V] [TRT] Tactic: 31 Time: 0.00979627
[11/24/2022-12:12:24] [V] [TRT] Fastest Tactic: 31 Time: 0.00979627
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:24] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31
[11/24/2022-12:12:24] [V] [TRT] *************** Autotuning format combination: Half(1:8,3696,84,1), Half(1:8,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:12:24] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:24] [V] [TRT] Tactic: 0 Time: 0.484576
[11/24/2022-12:12:24] [V] [TRT] Tactic: 1 Time: 0.664096
[11/24/2022-12:12:24] [V] [TRT] Tactic: 2 Time: 0.650409
[11/24/2022-12:12:24] [V] [TRT] Tactic: 3 Time: 0.992247
[11/24/2022-12:12:24] [V] [TRT] Tactic: 4 Time: 0.89355
[11/24/2022-12:12:24] [V] [TRT] Tactic: 5 Time: 0.648347
[11/24/2022-12:12:24] [V] [TRT] Tactic: 6 Time: 1.65308
[11/24/2022-12:12:24] [V] [TRT] Tactic: 7 Time: 1.15163
[11/24/2022-12:12:24] [V] [TRT] Tactic: 8 Time: 1.35084
[11/24/2022-12:12:24] [V] [TRT] Tactic: 9 Time: 0.965819
[11/24/2022-12:12:24] [V] [TRT] Tactic: 10 Time: 0.354501
[11/24/2022-12:12:24] [V] [TRT] Tactic: 11 Time: 0.463451
[11/24/2022-12:12:24] [V] [TRT] Tactic: 12 Time: 0.42773
[11/24/2022-12:12:24] [V] [TRT] Tactic: 13 Time: 0.631881
[11/24/2022-12:12:24] [V] [TRT] Tactic: 14 Time: 0.599968
[11/24/2022-12:12:24] [V] [TRT] Tactic: 15 Time: 0.417161
[11/24/2022-12:12:24] [V] [TRT] Tactic: 16 Time: 0.962455
[11/24/2022-12:12:24] [V] [TRT] Tactic: 17 Time: 0.756288
[11/24/2022-12:12:24] [V] [TRT] Tactic: 18 Time: 0.713568
[11/24/2022-12:12:24] [V] [TRT] Tactic: 19 Time: 0.518098
[11/24/2022-12:12:25] [V] [TRT] Tactic: 20 Time: 0.292814
[11/24/2022-12:12:25] [V] [TRT] Tactic: 21 Time: 0.390341
[11/24/2022-12:12:25] [V] [TRT] Tactic: 22 Time: 0.524325
[11/24/2022-12:12:25] [V] [TRT] Tactic: 23 Time: 0.800823
[11/24/2022-12:12:25] [V] [TRT] Tactic: 24 Time: 0.262793
[11/24/2022-12:12:25] [V] [TRT] Tactic: 25 Time: 0.339314
[11/24/2022-12:12:25] [V] [TRT] Tactic: 26 Time: 0.444686
[11/24/2022-12:12:25] [V] [TRT] Tactic: 27 Time: 0.666094
[11/24/2022-12:12:25] [V] [TRT] Tactic: 28 Time: 0.0588023
[11/24/2022-12:12:25] [V] [TRT] Tactic: 29 Time: 0.052064
[11/24/2022-12:12:25] [V] [TRT] Tactic: 30 Time: 0.0536396
[11/24/2022-12:12:25] [V] [TRT] Tactic: 31 Time: 0.0762674
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 29 Time: 0.052064
[11/24/2022-12:12:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29
[11/24/2022-12:12:25] [V] [TRT] *************** Autotuning format combination: Half(118272:32,3696,84,1), Half(118272:32,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 20 Time: 0.214043
[11/24/2022-12:12:25] [V] [TRT] Tactic: 21 Time: 0.202395
[11/24/2022-12:12:25] [V] [TRT] Tactic: 22 Time: 0.205065
[11/24/2022-12:12:25] [V] [TRT] Tactic: 23 Time: 0.207442
[11/24/2022-12:12:25] [V] [TRT] Tactic: 24 Time: 0.184923
[11/24/2022-12:12:25] [V] [TRT] Tactic: 25 Time: 0.183593
[11/24/2022-12:12:25] [V] [TRT] Tactic: 26 Time: 0.184736
[11/24/2022-12:12:25] [V] [TRT] Tactic: 27 Time: 0.184754
[11/24/2022-12:12:25] [V] [TRT] Tactic: 30 Time: 0.21285
[11/24/2022-12:12:25] [V] [TRT] Tactic: 31 Time: 0.184585
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 25 Time: 0.183593
[11/24/2022-12:12:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25
[11/24/2022-12:12:25] [V] [TRT] *************** Autotuning format combination: Int8(118272,3696,84,1), Int8(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 0 Time: 0.0105198
[11/24/2022-12:12:25] [V] [TRT] Tactic: 1 Time: 0.0101434
[11/24/2022-12:12:25] [V] [TRT] Tactic: 2 Time: 0.00985752
[11/24/2022-12:12:25] [V] [TRT] Tactic: 3 Time: 0.00982309
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4 Time: 0.00959939
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5 Time: 0.00928086
[11/24/2022-12:12:25] [V] [TRT] Tactic: 6 Time: 0.00947143
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7 Time: 0.00937486
[11/24/2022-12:12:25] [V] [TRT] Tactic: 8 Time: 0.00922886
[11/24/2022-12:12:25] [V] [TRT] Tactic: 9 Time: 0.00931686
[11/24/2022-12:12:25] [V] [TRT] Tactic: 28 Time: 0.010319
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 8 Time: 0.00922886
[11/24/2022-12:12:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
[11/24/2022-12:12:25] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1), Int8(29568,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 0 Time: 0.00929829
[11/24/2022-12:12:25] [V] [TRT] Tactic: 1 Time: 0.00886884
[11/24/2022-12:12:25] [V] [TRT] Tactic: 2 Time: 0.00761648
[11/24/2022-12:12:25] [V] [TRT] Tactic: 3 Time: 0.00886077
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4 Time: 0.00930343
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5 Time: 0.00949514
[11/24/2022-12:12:25] [V] [TRT] Tactic: 6 Time: 0.0102031
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7 Time: 0.0099971
[11/24/2022-12:12:25] [V] [TRT] Tactic: 8 Time: 0.0100925
[11/24/2022-12:12:25] [V] [TRT] Tactic: 9 Time: 0.0102331
[11/24/2022-12:12:25] [V] [TRT] Tactic: 10 Time: 0.0101096
[11/24/2022-12:12:25] [V] [TRT] Tactic: 11 Time: 0.00986606
[11/24/2022-12:12:25] [V] [TRT] Tactic: 12 Time: 0.00986941
[11/24/2022-12:12:25] [V] [TRT] Tactic: 13 Time: 0.00959147
[11/24/2022-12:12:25] [V] [TRT] Tactic: 14 Time: 0.0101245
[11/24/2022-12:12:25] [V] [TRT] Tactic: 15 Time: 0.00979901
[11/24/2022-12:12:25] [V] [TRT] Tactic: 16 Time: 0.0101376
[11/24/2022-12:12:25] [V] [TRT] Tactic: 17 Time: 0.0099325
[11/24/2022-12:12:25] [V] [TRT] Tactic: 18 Time: 0.0102436
[11/24/2022-12:12:25] [V] [TRT] Tactic: 19 Time: 0.0103696
[11/24/2022-12:12:25] [V] [TRT] Tactic: 20 Time: 0.012781
[11/24/2022-12:12:25] [V] [TRT] Tactic: 21 Time: 0.0104362
[11/24/2022-12:12:25] [V] [TRT] Tactic: 22 Time: 0.0100568
[11/24/2022-12:12:25] [V] [TRT] Tactic: 23 Time: 0.0096384
[11/24/2022-12:12:25] [V] [TRT] Tactic: 28 Time: 0.0102576
[11/24/2022-12:12:25] [V] [TRT] Tactic: 29 Time: 0.0104578
[11/24/2022-12:12:25] [V] [TRT] Tactic: 30 Time: 0.0126213
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 2 Time: 0.00761648
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:25] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2
[11/24/2022-12:12:25] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1), Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 10 Time: 0.00831187
[11/24/2022-12:12:25] [V] [TRT] Tactic: 11 Time: 0.00961493
[11/24/2022-12:12:25] [V] [TRT] Tactic: 12 Time: 0.00954301
[11/24/2022-12:12:25] [V] [TRT] Tactic: 13 Time: 0.0125688
[11/24/2022-12:12:25] [V] [TRT] Tactic: 14 Time: 0.0102671
[11/24/2022-12:12:25] [V] [TRT] Tactic: 15 Time: 0.0104536
[11/24/2022-12:12:25] [V] [TRT] Tactic: 16 Time: 0.0184497
[11/24/2022-12:12:25] [V] [TRT] Tactic: 17 Time: 0.0157271
[11/24/2022-12:12:25] [V] [TRT] Tactic: 18 Time: 0.0158048
[11/24/2022-12:12:25] [V] [TRT] Tactic: 19 Time: 0.0171967
[11/24/2022-12:12:25] [V] [TRT] Tactic: 20 Time: 0.00771753
[11/24/2022-12:12:25] [V] [TRT] Tactic: 21 Time: 0.00929486
[11/24/2022-12:12:25] [V] [TRT] Tactic: 22 Time: 0.0098813
[11/24/2022-12:12:25] [V] [TRT] Tactic: 23 Time: 0.0127615
[11/24/2022-12:12:25] [V] [TRT] Tactic: 24 Time: 0.00947743
[11/24/2022-12:12:25] [V] [TRT] Tactic: 25 Time: 0.00804038
[11/24/2022-12:12:25] [V] [TRT] Tactic: 26 Time: 0.00840955
[11/24/2022-12:12:25] [V] [TRT] Tactic: 27 Time: 0.0100745
[11/24/2022-12:12:25] [V] [TRT] Tactic: 29 Time: 0.0296357
[11/24/2022-12:12:25] [V] [TRT] Tactic: 30 Time: 0.0184086
[11/24/2022-12:12:25] [V] [TRT] Tactic: 31 Time: 0.0127211
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 20 Time: 0.00771753
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWise)
[11/24/2022-12:12:25] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 20
[11/24/2022-12:12:25] [V] [TRT] *************** Autotuning format combination: Int8(118272:32,3696,84,1), Int8(118272:32,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: PWN(node_of_669) (PointWiseV2)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 10 Time: 0.112366
[11/24/2022-12:12:25] [V] [TRT] Tactic: 11 Time: 0.10099
[11/24/2022-12:12:25] [V] [TRT] Tactic: 12 Time: 0.149271
[11/24/2022-12:12:25] [V] [TRT] Tactic: 13 Time: 0.101845
[11/24/2022-12:12:25] [V] [TRT] Tactic: 14 Time: 0.108933
[11/24/2022-12:12:25] [V] [TRT] Tactic: 15 Time: 0.160315
[11/24/2022-12:12:25] [V] [TRT] Tactic: 16 Time: 0.102949
[11/24/2022-12:12:25] [V] [TRT] Tactic: 17 Time: 0.110613
[11/24/2022-12:12:25] [V] [TRT] Tactic: 18 Time: 0.143767
[11/24/2022-12:12:25] [V] [TRT] Tactic: 19 Time: 0.186839
[11/24/2022-12:12:25] [V] [TRT] Tactic: 20 Time: 0.100903
[11/24/2022-12:12:25] [V] [TRT] Tactic: 21 Time: 0.100437
[11/24/2022-12:12:25] [V] [TRT] Tactic: 22 Time: 0.100542
[11/24/2022-12:12:25] [V] [TRT] Tactic: 23 Time: 0.100827
[11/24/2022-12:12:25] [V] [TRT] Tactic: 24 Time: 0.125198
[11/24/2022-12:12:25] [V] [TRT] Tactic: 25 Time: 0.103152
[11/24/2022-12:12:25] [V] [TRT] Tactic: 26 Time: 0.09936
[11/24/2022-12:12:25] [V] [TRT] Tactic: 27 Time: 0.0989943
[11/24/2022-12:12:25] [V] [TRT] Tactic: 29 Time: 0.681627
[11/24/2022-12:12:25] [V] [TRT] Tactic: 30 Time: 0.36416
[11/24/2022-12:12:25] [V] [TRT] Tactic: 31 Time: 0.217061
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 27 Time: 0.0989943
[11/24/2022-12:12:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27
[11/24/2022-12:12:25] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:25] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudaDepthwiseConvolution)
[11/24/2022-12:12:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (FusedConvActConvolution)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 589823 Time: 0.0466331
[11/24/2022-12:12:25] [V] [TRT] Tactic: 655359 Time: 0.04484
[11/24/2022-12:12:25] [V] [TRT] Tactic: 786431 Time: 0.0407863
[11/24/2022-12:12:25] [V] [TRT] Tactic: 851967 Time: 0.050592
[11/24/2022-12:12:25] [V] [TRT] Tactic: 1179647 Time: 0.0407429
[11/24/2022-12:12:25] [V] [TRT] Tactic: 1638399 Time: 0.0408491
[11/24/2022-12:12:25] [V] [TRT] Tactic: 2097151 Time: 0.043776
[11/24/2022-12:12:25] [V] [TRT] Tactic: 3538943 Time: 0.038216
[11/24/2022-12:12:25] [V] [TRT] Tactic: 3932159 Time: 0.0440651
[11/24/2022-12:12:25] [V] [TRT] Tactic: 3997695 Time: 0.0413097
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4194303 Time: 0.0395017
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4259839 Time: 0.0417909
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4587519 Time: 0.0401326
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4653055 Time: 0.0407109
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4915199 Time: 0.0409909
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4980735 Time: 0.0389486
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5177343 Time: 0.043744
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5242879 Time: 0.0412857
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5373951 Time: 0.0494735
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5570559 Time: 0.0396823
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5767167 Time: 0.0622019
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5898239 Time: 0.0407931
[11/24/2022-12:12:25] [V] [TRT] Tactic: 6225919 Time: 0.038616
[11/24/2022-12:12:25] [V] [TRT] Tactic: 6291455 Time: 0.0406126
[11/24/2022-12:12:25] [V] [TRT] Tactic: 6815743 Time: 0.0409966
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7012351 Time: 0.0437806
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7077887 Time: 0.0368263
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7143423 Time: 0.0465131
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7208959 Time: 0.0412949
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7340031 Time: 0.0409851
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7536639 Time: 0.0501303
[11/24/2022-12:12:25] [V] [TRT] Tactic: 7733247 Time: 0.0360103
[11/24/2022-12:12:25] [V] [TRT] Tactic: 8191999 Time: 0.0436137
[11/24/2022-12:12:25] [V] [TRT] Tactic: 8716287 Time: 0.0448594
[11/24/2022-12:12:25] [V] [TRT] Tactic: 9109503 Time: 0.044056
[11/24/2022-12:12:25] [V] [TRT] Tactic: 9568255 Time: 0.0410206
[11/24/2022-12:12:25] [V] [TRT] Tactic: 10354687 Time: 0.0412251
[11/24/2022-12:12:25] [V] [TRT] Tactic: 10747903 Time: 0.0374069
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 7733247 Time: 0.0360103
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudnnConvolution)
[11/24/2022-12:12:25] [V] [TRT] Tactic: 0 Time: 0.0519269
[11/24/2022-12:12:25] [V] [TRT] Tactic: 1 Time: 0.0544808
[11/24/2022-12:12:25] [V] [TRT] Tactic: 2 Time: 0.0583406
[11/24/2022-12:12:25] [V] [TRT] Tactic: 4 Time: 3.93713
[11/24/2022-12:12:25] [V] [TRT] Tactic: 5 Time: 0.148448
[11/24/2022-12:12:25] [V] [TRT] Tactic: 56 Time: 0.052992
[11/24/2022-12:12:25] [V] [TRT] Tactic: 57 Time: 0.0522834
[11/24/2022-12:12:25] [V] [TRT] Tactic: 58 Time: 0.058432
[11/24/2022-12:12:25] [V] [TRT] Tactic: 60 Time: 3.94016
[11/24/2022-12:12:25] [V] [TRT] Tactic: 61 Time: 0.136192
[11/24/2022-12:12:25] [V] [TRT] Tactic: 112 Time: 0.0495771
[11/24/2022-12:12:25] [V] [TRT] Tactic: 113 Time: 0.0502857
[11/24/2022-12:12:25] [V] [TRT] Tactic: 114 Time: 0.0582019
[11/24/2022-12:12:25] [V] [TRT] Tactic: 116 Time: 3.93344
[11/24/2022-12:12:25] [V] [TRT] Tactic: 117 Time: 0.133451
[11/24/2022-12:12:25] [V] [TRT] Fastest Tactic: 112 Time: 0.0495771
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:25] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:25] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:12:26] [V] [TRT] Tactic: 621442388677115936 Time: 0.046288
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:12:26] [V] [TRT] Tactic: 697756878388249475 Time: 0.0240571
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0219513
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1327459216264546184 Time: 0.027117
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0218847
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0414583
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0641082
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0269333
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0213747
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0425371
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0271573
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0296512
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0351113
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0216725
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0298651
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0186971
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0361371
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6901214267543238617 Time: 0.0298999
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0410869
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:12:26] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0245463
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0271848
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0217789
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0215758
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0182674
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0354587
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0606598
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0241189
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0185714
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0271855
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0372971
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0189777
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0437954
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0218847
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1349585930542925704 Time: 0.03588
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0274697
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:12:26] [V] [TRT] Tactic: -701551393537224327 Time: 0.0212108
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3258434593395023 Time: 0.0327607
[11/24/2022-12:12:26] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0182674
[11/24/2022-12:12:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0327159
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0244792
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0187137
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0192863
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4474630279712975759 Time: 0.01584
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0157042
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4696204239951173149 Time: 0.018632
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0242385
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0200949
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0242255
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0188589
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0184623
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0240968
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0304795
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0156937
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0187823
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0244427
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1985235291706575900 Time: 0.024352
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:12:26] [V] [TRT] Tactic: -504296718212024303 Time: 0.0241989
[11/24/2022-12:12:26] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0156937
[11/24/2022-12:12:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0156663
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0129741
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0138938
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0184389
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0157586
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5610788582700027969 Time: 0.01252
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0187086
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0158368
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0246027
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0214054
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:12:26] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0182234
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0159639
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0151246
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0210632
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0160696
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0211912
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0184634
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0245745
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0185406
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0156498
[11/24/2022-12:12:26] [V] [TRT] Fastest Tactic: 5610788582700027969 Time: 0.01252
[11/24/2022-12:12:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5610788582700027969
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudnnConvolution)
[11/24/2022-12:12:26] [V] [TRT] Tactic: 0 Time: 0.0524693
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1 Time: 0.0618545
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2 Time: 0.06112
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4 Time: 3.94147
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5 Time: 0.154071
[11/24/2022-12:12:26] [V] [TRT] Tactic: 56 Time: 0.0508785
[11/24/2022-12:12:26] [V] [TRT] Tactic: 58 Time: 0.061629
[11/24/2022-12:12:26] [V] [TRT] Tactic: 60 Time: 3.92364
[11/24/2022-12:12:26] [V] [TRT] Tactic: 61 Time: 0.141685
[11/24/2022-12:12:26] [V] [TRT] Fastest Tactic: 56 Time: 0.0508785
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (FusedConvActConvolution)
[11/24/2022-12:12:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0129794
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3891805945559659536 Time: 0.024259
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0154066
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0156183
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0154437
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:12:26] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0126541
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0201457
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4374269919094467161 Time: 0.012789
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0242126
[11/24/2022-12:12:26] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0126541
[11/24/2022-12:12:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudaDepthwiseConvolution)
[11/24/2022-12:12:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:12:26] [V] [TRT] Tactic: 254850674756030979 Time: 0.0132102
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0136515
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0122312
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0131915
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 1236070762725864170
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1236070762725864170 Time: 0.00971794
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 1297835561412423383
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1297835561412423383 Time: 0.0124069
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0107948
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 1484051751570462061
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1484051751570462061 Time: 0.0101099
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0272556
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 1710761387006445904
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1710761387006445904 Time: 0.0133091
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 1788275858806332606
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1788275858806332606 Time: 0.0127078
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0158345
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0125547
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 1876080869840372148
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1876080869840372148 Time: 0.00910857
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1877373136269439559 Time: 0.025069
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0172561
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 2014386895388196995
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2014386895388196995 Time: 0.008964
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0184314
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 2285052789339973171
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2285052789339973171 Time: 0.00976914
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0131063
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0183749
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0244053
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 2885411890874123330
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2885411890874123330 Time: 0.00925571
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:12:26] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0127962
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 3014367713063089410
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3014367713063089410 Time: 0.00914886
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3071479995783211391 Time: 0.010814
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 3094146840800930111
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3094146840800930111 Time: 0.0125806
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 3111630609330706559
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3111630609330706559 Time: 0.0128941
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 3293261797412283333
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3293261797412283333 Time: 0.00977158
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 3355662717192093688
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3355662717192093688 Time: 0.0131985
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3359475309458902373 Time: 0.00974598
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0182994
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0150583
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0131823
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 3821081349796384238
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3821081349796384238 Time: 0.0100965
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0124267
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 3900825777106964947
[11/24/2022-12:12:26] [V] [TRT] Tactic: 3900825777106964947 Time: 0.0146597
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4278315135102886928 Time: 0.02424
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0097539
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4480294673430783793 Time: 0.00985813
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0123985
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0100175
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0126899
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0133211
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4595173549602041350 Time: 0.018276
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0126743
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:12:26] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00967131
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0130843
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0131591
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5205510332404400949 Time: 0.012813
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0159131
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:12:26] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0128956
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 6006391580592745401
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6006391580592745401 Time: 0.0154834
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0159065
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0131998
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 6373920594237855975
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6373920594237855975 Time: 0.012373
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0181537
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0182023
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 6580047526417007834
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6580047526417007834 Time: 0.0144622
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0127886
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0271436
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:12:26] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0157541
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:12:26] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0122503
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:12:26] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0124175
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 7671477676541500689
[11/24/2022-12:12:26] [V] [TRT] Tactic: 7671477676541500689 Time: 0.0128244
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0124792
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0180966
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0169575
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 8270193703352283962
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8270193703352283962 Time: 0.0098685
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 8609386743006631101
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8609386743006631101 Time: 0.009494
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 8612200391988441496
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8612200391988441496 Time: 0.00931086
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0128434
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0100989
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:12:26] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0121653
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:12:26] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00924886
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:12:26] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0126278
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0227833
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0129589
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0125208
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0104
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -8006601114930636709
[11/24/2022-12:12:26] [V] [TRT] Tactic: -8006601114930636709 Time: 0.0130419
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -7798149971944012698
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7798149971944012698 Time: 0.00957714
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -7683747554614165540
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7683747554614165540 Time: 0.0127044
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -7604212447063563295
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7604212447063563295 Time: 0.00911657
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -7528383910611180842
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7528383910611180842 Time: 0.00921229
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -7428355835493435592
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7428355835493435592 Time: 0.0104134
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7410012245391920273 Time: 0.024336
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -7109456194156851009
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7109456194156851009 Time: 0.00962743
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0127333
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:12:26] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0213127
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -6789949785717718640
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6789949785717718640 Time: 0.0100544
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6768327495007644783 Time: 0.0121783
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -6594872535430699497
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6594872535430699497 Time: 0.00934457
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -6510960431881136297
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6510960431881136297 Time: 0.00933371
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0269166
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:12:26] [V] [TRT] Tactic: -6063766379489217211 Time: 0.015568
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0132359
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00930943
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0124846
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5161596964442251102 Time: 0.018692
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0158969
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0140883
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -5082750115275722821
[11/24/2022-12:12:26] [V] [TRT] Tactic: -5082750115275722821 Time: 0.0102955
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0125615
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0274194
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0160782
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0124625
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0157166
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0133531
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:12:26] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0242857
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0296814
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0130602
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0115938
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0123566
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0156393
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0103523
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0129699
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -3168858964887995726
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3168858964887995726 Time: 0.0119086
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:12:26] [V] [TRT] Tactic: -3058330359340425555 Time: 0.018656
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0102648
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0165445
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -2590123377344686639
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2590123377344686639 Time: 0.01709
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -2365592821493052948
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2365592821493052948 Time: 0.0156041
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0125356
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0159411
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:12:26] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0158373
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0124922
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -1935873158869965959
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1935873158869965959 Time: 0.0158979
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -1871293198177288380
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1871293198177288380 Time: 0.0130095
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0104549
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0125794
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0123756
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0221799
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0214968
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:12:26] [V] [TRT] Tactic: -1038291877007553549 Time: 0.015568
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -563413451241559339
[11/24/2022-12:12:26] [V] [TRT] Tactic: -563413451241559339 Time: 0.0129531
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: -517813403956506640
[11/24/2022-12:12:26] [V] [TRT] Tactic: -517813403956506640 Time: 0.0124792
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:12:26] [V] [TRT] Tactic: -406984317033388136 Time: 0.0129585
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -356933163344202008
[11/24/2022-12:12:26] [V] [TRT] Tactic: -356933163344202008 Time: 0.00940371
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:12:26] [V] [TRT] Tactic: -331499326992534460 Time: 0.012339
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: -291069119579384883
[11/24/2022-12:12:26] [V] [TRT] Tactic: -291069119579384883 Time: 0.00908829
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:12:26] [V] [TRT] Tactic: -206523504474952360 Time: 0.0156645
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -175265966321316526
[11/24/2022-12:12:26] [V] [TRT] Tactic: -175265966321316526 Time: 0.0129512
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -93196984589102737
[11/24/2022-12:12:26] [V] [TRT] Tactic: -93196984589102737 Time: 0.00969661
[11/24/2022-12:12:26] [V] [TRT] Fastest Tactic: 2014386895388196995 Time: 0.008964
[11/24/2022-12:12:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2014386895388196995
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CublasConvolution)
[11/24/2022-12:12:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudaDepthwiseConvolution)
[11/24/2022-12:12:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:26] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:12:26] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0211984
[11/24/2022-12:12:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0210893
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3239257003214966313 Time: 0.021342
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0149463
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0158126
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0134562
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0158176
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0143525
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:12:27] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0153595
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0155008
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:12:27] [V] [TRT] Tactic: -108011214168778087 Time: 0.0151045
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:12:27] [V] [TRT] Tactic: -42427192380281294 Time: 0.0159096
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0134562
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudaDepthwiseConvolution)
[11/24/2022-12:12:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (FusedConvActConvolution)
[11/24/2022-12:12:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:12:27] [V] [TRT] Tactic: 175853789719975416 Time: 0.0115168
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2171150287007712632 Time: 0.012323
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0126434
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0128358
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0159121
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0106309
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0106916
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0125718
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0108127
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0159365
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0104607
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:12:27] [V] [TRT] Tactic: -683636008127039856 Time: 0.015872
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.0104607
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0104549
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2855900226702061782 Time: 0.015733
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0125524
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0156896
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0125608
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0103873
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0105055
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0158832
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0104346
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3111968753064955248 Time: 0.011833
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0106596
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:12:27] [V] [TRT] Tactic: -868495160148524802 Time: 0.0125467
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.0103873
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0118231
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0124023
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0121691
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0118231
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0124385
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00995413
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0102589
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0125558
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5012796702462679112 Time: 0.012976
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0129707
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0114933
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0156951
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0108196
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0125154
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0121322
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00968076
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0126476
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0127082
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0127745
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0130489
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0153321
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0127939
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0102756
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0126758
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7282232519526877434 Time: 0.012984
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0102047
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0104692
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0125745
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0128987
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0102397
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0132256
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0125143
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0123577
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:12:27] [V] [TRT] Tactic: -2342404147487779225 Time: 0.010494
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0126834
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:12:27] [V] [TRT] Tactic: -621838502160440068 Time: 0.0127661
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: 8584126525867982141 Time: 0.00968076
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8584126525867982141
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:12:27] [V] [TRT] Tactic: 424230345342282109 Time: 0.0123867
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00951286
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2327398338581585326 Time: 0.013098
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0102687
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0132202
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0118108
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7107586691882206281 Time: 0.011015
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0123272
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00932286
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0125768
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0121074
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0118249
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00998857
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00954575
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00921743
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:12:27] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0099907
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00974141
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00776662
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00952472
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0118569
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0119672
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6183300053070809929 Time: 0.00988831
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0150789
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0102687
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00782148
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00912
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0123455
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0151511
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:12:27] [V] [TRT] Tactic: -2649556861007671996 Time: 0.009242
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0123794
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0105427
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:12:27] [V] [TRT] Tactic: -50323486981480818 Time: 0.010337
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.00776662
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudaGroupConvolution)
[11/24/2022-12:12:27] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CudaDepthwiseConvolution)
[11/24/2022-12:12:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (FusedConvActConvolution)
[11/24/2022-12:12:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_670 + node_of_671 + node_of_672 (CaskConvolution)
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:12:27] [V] [TRT] Tactic: 125145153013230687 Time: 0.0128549
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0125882
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0121714
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00916571
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00915429
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3043273137345374664 Time: 0.0103461
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00958537
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00996267
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00946086
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4610760414797216079 Time: 0.011507
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00944257
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00938428
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0119451
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00871664
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0103262
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0133162
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00961189
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6433368103202497147 Time: 0.00938057
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0100971
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0173217
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0120846
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00988952
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0101739
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0129524
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00977249
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8142283985160822229 Time: 0.00984564
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0151717
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0102511
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0113797
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0120789
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:12:27] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0120674
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:12:27] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0116111
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00924657
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00814197
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:12:27] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0126251
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0119078
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0126971
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:12:27] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0102727
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00957013
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0110087
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0121699
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:12:27] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0178949
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00766075
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00928686
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:12:27] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0126263
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:12:27] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00842003
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:12:27] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0124335
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:12:27] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0152553
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0124579
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0132771
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0120629
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:12:27] [V] [TRT] Tactic: -1006589727652607355 Time: 0.0079393
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:12:27] [V] [TRT] Tactic: -405554772060757402 Time: 0.009344
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:12:27] [V] [TRT] Tactic: -375949437730908730 Time: 0.00936429
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:12:27] [V] [TRT] Tactic: -111878368089469751 Time: 0.0112471
[11/24/2022-12:12:27] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:12:27] [V] [TRT] Tactic: -19707840769375107 Time: 0.00764271
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: -19707840769375107 Time: 0.00764271
[11/24/2022-12:12:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -19707840769375107
[11/24/2022-12:12:27] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(29568,1,1344,32) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(7392,1:4,336,8) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(29568,924,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(14784,924:2,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(3696,1:8,168,4) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(7392,924:4,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(29568,924,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(924,924:32,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:12:27] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(29568,924,42,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(29568,1,1344,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(7392,1:4,336,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(29568,924,42,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(14784,924:2,42,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(3696,1:8,168,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(1848,1:16,84,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(924,924:32,42,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(7392,924:4,42,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(7392,924:4,42,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1), Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32), Float(118272,1,2688,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8), Float(29568,1:4,672,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(3696,3696:32,84,1), Float(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(1:4,3696,84,1), Float(1:4,3696,84,1) -> Float(1:4,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1), Half(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1), Half(59136,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4), Half(14784,1:8,336,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2), Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1), Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(1:8,3696,84,1), Half(1:8,3696,84,1) -> Half(1:8,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(118272:32,3696,84,1), Half(118272:32,3696,84,1) -> Half(118272:32,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(118272,3696,84,1), Int8(118272,3696,84,1) -> Int8(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1), Int8(29568,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1), Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(118272:32,3696,84,1), Int8(118272:32,3696,84,1) -> Int8(118272:32,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(118272,1,2688,32) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(29568,1:4,672,8) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(59136,3696:2,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(14784,1:8,336,4) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(29568,3696:4,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(118272,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:27] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudaDepthwiseConvolution)
[11/24/2022-12:12:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (FusedConvActConvolution)
[11/24/2022-12:12:27] [V] [TRT] Tactic: 589823 Time: 0.0347502
[11/24/2022-12:12:27] [V] [TRT] Tactic: 655359 Time: 0.0362286
[11/24/2022-12:12:27] [V] [TRT] Tactic: 786431 Time: 0.0290752
[11/24/2022-12:12:27] [V] [TRT] Tactic: 851967 Time: 0.0400286
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1179647 Time: 0.0292123
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1638399 Time: 0.0269722
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2097151 Time: 0.0290807
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3538943 Time: 0.028939
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3932159 Time: 0.0341093
[11/24/2022-12:12:27] [V] [TRT] Tactic: 3997695 Time: 0.0290359
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4194303 Time: 0.0284465
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4259839 Time: 0.028451
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4587519 Time: 0.0268846
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4653055 Time: 0.0303003
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4915199 Time: 0.0286318
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4980735 Time: 0.0283131
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5177343 Time: 0.0318263
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5242879 Time: 0.0313317
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5373951 Time: 0.0371771
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5570559 Time: 0.0317449
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5767167 Time: 0.0486034
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5898239 Time: 0.0295031
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6225919 Time: 0.0288384
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6291455 Time: 0.0292635
[11/24/2022-12:12:27] [V] [TRT] Tactic: 6815743 Time: 0.0317339
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7012351 Time: 0.0290962
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7077887 Time: 0.0263596
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7143423 Time: 0.0350409
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7208959 Time: 0.0312384
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7340031 Time: 0.0318455
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7536639 Time: 0.0400469
[11/24/2022-12:12:27] [V] [TRT] Tactic: 7733247 Time: 0.026531
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8191999 Time: 0.0316992
[11/24/2022-12:12:27] [V] [TRT] Tactic: 8716287 Time: 0.0335131
[11/24/2022-12:12:27] [V] [TRT] Tactic: 9109503 Time: 0.0312905
[11/24/2022-12:12:27] [V] [TRT] Tactic: 9568255 Time: 0.0284015
[11/24/2022-12:12:27] [V] [TRT] Tactic: 10354687 Time: 0.0271764
[11/24/2022-12:12:27] [V] [TRT] Tactic: 10747903 Time: 0.0280655
[11/24/2022-12:12:27] [V] [TRT] Fastest Tactic: 7077887 Time: 0.0263596
[11/24/2022-12:12:27] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudnnConvolution)
[11/24/2022-12:12:27] [V] [TRT] Tactic: 0 Time: 0.0523825
[11/24/2022-12:12:27] [V] [TRT] Tactic: 1 Time: 0.0503208
[11/24/2022-12:12:27] [V] [TRT] Tactic: 2 Time: 0.0557486
[11/24/2022-12:12:27] [V] [TRT] Tactic: 4 Time: 2.91224
[11/24/2022-12:12:27] [V] [TRT] Tactic: 5 Time: 0.136622
[11/24/2022-12:12:27] [V] [TRT] Tactic: 56 Time: 0.0529234
[11/24/2022-12:12:27] [V] [TRT] Tactic: 57 Time: 0.0504396
[11/24/2022-12:12:27] [V] [TRT] Tactic: 58 Time: 0.0549897
[11/24/2022-12:12:27] [V] [TRT] Tactic: 60 Time: 2.91435
[11/24/2022-12:12:27] [V] [TRT] Tactic: 61 Time: 0.139225
[11/24/2022-12:12:27] [V] [TRT] Tactic: 112 Time: 0.0527695
[11/24/2022-12:12:27] [V] [TRT] Tactic: 113 Time: 0.0521829
[11/24/2022-12:12:27] [V] [TRT] Tactic: 114 Time: 0.0571733
[11/24/2022-12:12:28] [V] [TRT] Tactic: 116 Time: 2.91951
[11/24/2022-12:12:28] [V] [TRT] Tactic: 117 Time: 0.137216
[11/24/2022-12:12:28] [V] [TRT] Fastest Tactic: 1 Time: 0.0503208
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:12:28] [V] [TRT] Tactic: 621442388677115936 Time: 0.0423897
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:12:28] [V] [TRT] Tactic: 697756878388249475 Time: 0.0209953
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0207837
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0254888
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0208196
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2310520233542099555 Time: 0.0375554
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0592594
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4032904638566464623 Time: 0.023806
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0182731
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0393154
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0262476
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0264244
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0318994
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6210049212073459059 Time: 0.019904
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0265356
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6723161876874263939 Time: 0.017795
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0343744
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6901214267543238617 Time: 0.028371
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0374171
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:12:28] [V] [TRT] Tactic: 9151672657204310840 Time: 0.023345
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0238309
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0208464
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0207327
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0156498
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0320667
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0553295
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0211657
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0164683
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6273689210331812572 Time: 0.02632
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4562045946847239058 Time: 0.034464
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0180371
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0401646
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0207386
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0324334
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0262766
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:12:28] [V] [TRT] Tactic: -701551393537224327 Time: 0.0184194
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3258434593395023 Time: 0.0292507
[11/24/2022-12:12:28] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0156498
[11/24/2022-12:12:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0291785
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0230909
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0179737
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0181937
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0151703
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0150949
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0177864
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0236147
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0180943
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8918020581761223752 Time: 0.022144
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0179789
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0157499
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0209874
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0291474
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0149787
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0180291
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2809379259463049391 Time: 0.02352
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0214387
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:12:28] [V] [TRT] Tactic: -504296718212024303 Time: 0.0224666
[11/24/2022-12:12:28] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0149787
[11/24/2022-12:12:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0146747
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0122975
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0127581
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5108195418077987197 Time: 0.017725
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0149376
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0119212
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0181446
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0149879
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0226201
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0205799
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:12:28] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0156233
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0151346
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0134886
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0182223
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6073218138311523634 Time: 0.015275
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0180697
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0162418
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1450865838092804082 Time: 0.02176
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0155278
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0145486
[11/24/2022-12:12:28] [V] [TRT] Fastest Tactic: 5610788582700027969 Time: 0.0119212
[11/24/2022-12:12:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5610788582700027969
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudnnConvolution)
[11/24/2022-12:12:28] [V] [TRT] Tactic: 0 Time: 0.0511406
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1 Time: 0.0593859
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2 Time: 0.0583665
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4 Time: 2.87441
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5 Time: 0.139385
[11/24/2022-12:12:28] [V] [TRT] Tactic: 56 Time: 0.04428
[11/24/2022-12:12:28] [V] [TRT] Tactic: 58 Time: 0.057088
[11/24/2022-12:12:28] [V] [TRT] Tactic: 60 Time: 2.87678
[11/24/2022-12:12:28] [V] [TRT] Tactic: 61 Time: 0.142846
[11/24/2022-12:12:28] [V] [TRT] Fastest Tactic: 56 Time: 0.04428
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (FusedConvActConvolution)
[11/24/2022-12:12:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0120526
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0207869
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0125509
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5548126322150286555 Time: 0.013009
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0128152
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:12:28] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0119379
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0178571
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0118748
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0206949
[11/24/2022-12:12:28] [V] [TRT] Fastest Tactic: -4374269919094467161 Time: 0.0118748
[11/24/2022-12:12:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4374269919094467161
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudaDepthwiseConvolution)
[11/24/2022-12:12:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:28] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:28] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:12:28] [V] [TRT] Tactic: 254850674756030979 Time: 0.0123387
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0123615
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0100864
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0124411
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 1236070762725864170
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1236070762725864170 Time: 0.00908657
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 1297835561412423383
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1297835561412423383 Time: 0.00961372
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1362727228442059924 Time: 0.00972526
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 1484051751570462061
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1484051751570462061 Time: 0.00940629
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0235729
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 1710761387006445904
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1710761387006445904 Time: 0.0114539
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 1788275858806332606
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1788275858806332606 Time: 0.00954179
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0146661
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0118597
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 1876080869840372148
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1876080869840372148 Time: 0.00820571
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0234717
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:12:28] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0151131
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 2014386895388196995
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2014386895388196995 Time: 0.00752722
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0155538
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 2285052789339973171
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2285052789339973171 Time: 0.00925771
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0123573
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0154597
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0222589
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 2885411890874123330
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2885411890874123330 Time: 0.00871449
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:12:28] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0117946
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 3014367713063089410
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3014367713063089410 Time: 0.00846037
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3071479995783211391 Time: 0.00973714
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 3094146840800930111
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3094146840800930111 Time: 0.00943886
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 3111630609330706559
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3111630609330706559 Time: 0.00957623
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 3293261797412283333
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3293261797412283333 Time: 0.00921743
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 3355662717192093688
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3355662717192093688 Time: 0.00996053
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3359475309458902373 Time: 0.009144
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0153893
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0123181
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0122998
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 3821081349796384238
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3821081349796384238 Time: 0.00962712
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0101455
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 3900825777106964947
[11/24/2022-12:12:28] [V] [TRT] Tactic: 3900825777106964947 Time: 0.0109915
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0205336
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4370476717970497892 Time: 0.009016
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4480294673430783793 Time: 0.00911172
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0100096
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00944286
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0118643
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4571819373777460444 Time: 0.012299
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0152923
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0117342
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:12:28] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00889896
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0122122
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0122621
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0119566
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0149435
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:12:28] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0119429
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 6006391580592745401
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6006391580592745401 Time: 0.014928
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0151008
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0124415
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 6373920594237855975
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6373920594237855975 Time: 0.00997669
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0151589
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0152681
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 6580047526417007834
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6580047526417007834 Time: 0.0117915
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0119444
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6724319788728799540 Time: 0.023407
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:12:28] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0147694
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:12:28] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0100084
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:12:28] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0101812
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 7671477676541500689
[11/24/2022-12:12:28] [V] [TRT] Tactic: 7671477676541500689 Time: 0.0118235
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0102198
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0152274
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8170606396342855895 Time: 0.015211
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 8270193703352283962
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8270193703352283962 Time: 0.009008
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 8609386743006631101
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8609386743006631101 Time: 0.00837206
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 8612200391988441496
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8612200391988441496 Time: 0.00815695
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0119051
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00937743
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:12:28] [V] [TRT] Tactic: 8839784824303350101 Time: 0.00988526
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:12:28] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00814374
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:12:28] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0119177
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0206178
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0121661
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0106149
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8131857373260504832 Time: 0.00953447
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -8006601114930636709
[11/24/2022-12:12:28] [V] [TRT] Tactic: -8006601114930636709 Time: 0.00965242
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -7798149971944012698
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7798149971944012698 Time: 0.00906971
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -7683747554614165540
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7683747554614165540 Time: 0.00936686
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -7604212447063563295
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7604212447063563295 Time: 0.00863247
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -7528383910611180842
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7528383910611180842 Time: 0.00751474
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -7428355835493435592
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7428355835493435592 Time: 0.00968899
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0208124
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -7109456194156851009
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7109456194156851009 Time: 0.00900143
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0118052
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:12:28] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0180457
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -6789949785717718640
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6789949785717718640 Time: 0.00918029
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6768327495007644783 Time: 0.00998339
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -6594872535430699497
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6594872535430699497 Time: 0.00796698
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -6510960431881136297
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6510960431881136297 Time: 0.0086365
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0233685
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:12:28] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0145554
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0121013
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00860262
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0118724
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0174532
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0150414
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0124236
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -5082750115275722821
[11/24/2022-12:12:28] [V] [TRT] Tactic: -5082750115275722821 Time: 0.00927629
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0119387
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4796511246675321840 Time: 0.025136
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0151392
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0100434
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0129021
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0125874
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:12:28] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0210011
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0260008
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0120255
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3903342530518878192 Time: 0.00981455
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0100258
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3601464762214218301 Time: 0.014901
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3234716536615144018 Time: 0.00972404
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0121672
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -3168858964887995726
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3168858964887995726 Time: 0.00989562
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:12:28] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0170037
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2878731503146438856 Time: 0.00944343
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0151497
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -2590123377344686639
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2590123377344686639 Time: 0.0150642
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -2365592821493052948
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2365592821493052948 Time: 0.0146162
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0113586
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0149984
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:12:28] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0149312
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0116385
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -1935873158869965959
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1935873158869965959 Time: 0.0124339
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -1871293198177288380
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1871293198177288380 Time: 0.0120632
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00969448
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0110818
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0100648
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0205068
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0195
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:12:28] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0126434
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -563413451241559339
[11/24/2022-12:12:28] [V] [TRT] Tactic: -563413451241559339 Time: 0.00947343
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: -517813403956506640
[11/24/2022-12:12:28] [V] [TRT] Tactic: -517813403956506640 Time: 0.00931143
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:12:28] [V] [TRT] Tactic: -406984317033388136 Time: 0.0121802
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -356933163344202008
[11/24/2022-12:12:28] [V] [TRT] Tactic: -356933163344202008 Time: 0.0086244
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:12:28] [V] [TRT] Tactic: -331499326992534460 Time: 0.00972678
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: -291069119579384883
[11/24/2022-12:12:28] [V] [TRT] Tactic: -291069119579384883 Time: 0.0076646
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:12:28] [V] [TRT] Tactic: -206523504474952360 Time: 0.0144759
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -175265966321316526
[11/24/2022-12:12:28] [V] [TRT] Tactic: -175265966321316526 Time: 0.00982644
[11/24/2022-12:12:28] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -93196984589102737
[11/24/2022-12:12:29] [V] [TRT] Tactic: -93196984589102737 Time: 0.00901057
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: -7528383910611180842 Time: 0.00751474
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7528383910611180842
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CublasConvolution)
[11/24/2022-12:12:29] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudaDepthwiseConvolution)
[11/24/2022-12:12:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1508480131241957639 Time: 0.017964
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0179589
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3239257003214966313 Time: 0.018024
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0125192
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0148626
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0124328
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0148695
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4443833619060044580 Time: 0.012349
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:12:29] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0123821
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0124941
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:12:29] [V] [TRT] Tactic: -108011214168778087 Time: 0.0124701
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:12:29] [V] [TRT] Tactic: -42427192380281294 Time: 0.0148521
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: -4443833619060044580 Time: 0.012349
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4443833619060044580
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudaDepthwiseConvolution)
[11/24/2022-12:12:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (FusedConvActConvolution)
[11/24/2022-12:12:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:12:29] [V] [TRT] Tactic: 175853789719975416 Time: 0.00979291
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0100172
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0120362
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0120217
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6299962968199310600 Time: 0.014784
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6341572697076960911 Time: 0.00967985
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8626990807754934295 Time: 0.00976701
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0112485
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7303593854972602201 Time: 0.00984655
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0149961
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3326139578711341011 Time: 0.00957775
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:12:29] [V] [TRT] Tactic: -683636008127039856 Time: 0.0149033
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: -3326139578711341011 Time: 0.00957775
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3326139578711341011
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1100922622480907544 Time: 0.00954545
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0146025
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3606311198834416176 Time: 0.011944
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:12:29] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0147707
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0105894
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6934773036503365000 Time: 0.00953509
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4431642509665791294 Time: 0.00976823
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0149093
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3958182351168863467 Time: 0.00982613
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3111968753064955248 Time: 0.00989653
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1492575840277333548 Time: 0.00958019
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:12:29] [V] [TRT] Tactic: -868495160148524802 Time: 0.0118755
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.00953509
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3426497547019031858 Time: 0.00949829
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0099584
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5287526117701381005 Time: 0.00962621
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.00949829
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0111075
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00941
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00928286
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:12:29] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0113621
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0122004
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0122792
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6618077155362058131 Time: 0.00976579
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0147867
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7348718297764976805 Time: 0.00970027
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0115225
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7970271430402365872 Time: 0.01002
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00897486
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0117662
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0118906
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8069335661823714580 Time: 0.01192
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0120396
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0127383
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0121295
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00943486
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0117967
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0120975
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00945486
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6406011580107094428 Time: 0.00974385
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0118108
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0120598
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0095616
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0122396
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0116424
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0100291
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:12:29] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0096253
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0118256
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:12:29] [V] [TRT] Tactic: -621838502160440068 Time: 0.0120091
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: 8584126525867982141 Time: 0.00897486
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8584126525867982141
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:12:29] [V] [TRT] Tactic: 424230345342282109 Time: 0.010383
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00880269
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0121813
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2881044142075831475 Time: 0.00959857
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:12:29] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0121836
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5730376045873629665 Time: 0.00978469
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7107586691882206281 Time: 0.00999223
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7178538052023824067 Time: 0.012099
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00936057
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0121371
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0116079
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0100376
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00973531
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00932571
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00893472
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:12:29] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0096576
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00985265
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0073504
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00935857
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0101154
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0100322
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6183300053070809929 Time: 0.009514
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0140962
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0100398
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00776565
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00908229
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0121276
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0149733
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:12:29] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00914828
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0122693
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0100885
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:12:29] [V] [TRT] Tactic: -50323486981480818 Time: 0.0100392
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.0073504
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudaGroupConvolution)
[11/24/2022-12:12:29] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CudaDepthwiseConvolution)
[11/24/2022-12:12:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (FusedConvActConvolution)
[11/24/2022-12:12:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_681 + node_of_682 + node_of_683 (CaskConvolution)
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:12:29] [V] [TRT] Tactic: 125145153013230687 Time: 0.0125752
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0124309
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0118959
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00868034
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00877392
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00996632
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00970484
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00972008
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:12:29] [V] [TRT] Tactic: 4112572034735311841 Time: 0.009382
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:12:29] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0101745
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:12:29] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00925743
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5204702486885981735 Time: 0.009154
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0105241
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00864108
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:12:29] [V] [TRT] Tactic: 5986622376339202983 Time: 0.00991695
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6007888770437705057 Time: 0.0126968
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00955429
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6433368103202497147 Time: 0.00904171
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00988373
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6443933097134654777 Time: 0.0154519
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6457435868048963632 Time: 0.0117662
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00957714
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6925201228918187099 Time: 0.00976061
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:12:29] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0125432
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:12:29] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00943429
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8142283985160822229 Time: 0.00964724
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8173975624668590862 Time: 0.014677
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8234775147403903473 Time: 0.00993067
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0101824
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:12:29] [V] [TRT] Tactic: 8765382722978397630 Time: 0.011853
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:12:29] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0118045
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:12:29] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0100389
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00932657
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00772331
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:12:29] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0123017
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5671123121710113970 Time: 0.0112035
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0122762
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00999893
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00928571
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4425346730823666456 Time: 0.01002
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0119147
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:12:29] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0176269
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00744411
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00895629
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:12:29] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0124705
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:12:29] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00784
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:12:29] [V] [TRT] Tactic: -2432868635536396215 Time: 0.012251
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:12:29] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0148736
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0123326
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0127036
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0118593
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:12:29] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00767038
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:12:29] [V] [TRT] Tactic: -405554772060757402 Time: 0.00918143
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:12:29] [V] [TRT] Tactic: -375949437730908730 Time: 0.00916457
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:12:29] [V] [TRT] Tactic: -111878368089469751 Time: 0.0102936
[11/24/2022-12:12:29] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:12:29] [V] [TRT] Tactic: -19707840769375107 Time: 0.00742857
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: -19707840769375107 Time: 0.00742857
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -19707840769375107
[11/24/2022-12:12:29] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Float(88704,3696,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] Tactic: 0 Time: 0.11219
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1 Time: 0.112254
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3 Time: 7.71847
[11/24/2022-12:12:29] [V] [TRT] Tactic: 24 Time: 0.237367
[11/24/2022-12:12:29] [V] [TRT] Tactic: 25 Time: 0.260887
[11/24/2022-12:12:29] [V] [TRT] Tactic: 27 Time: 8.46907
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: 0 Time: 0.11219
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] Tactic: 0 Time: 0.439826
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: 0 Time: 0.439826
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:29] [V] [TRT] node_of_684 Set Tactic Name: sm50_xmma_deconv_generic_f32f32_f32_f32_nchwkcrs_nchw Tactic: 1108745107350470483
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 0
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Float(88704,1,2016,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:29] [V] [TRT] node_of_684 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 1461874880923808087
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1461874880923808087 Time: 1.78773
[11/24/2022-12:12:29] [V] [TRT] node_of_684 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x128x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2647374945310797548
[11/24/2022-12:12:29] [V] [TRT] Tactic: 2647374945310797548 Time: 5.25646
[11/24/2022-12:12:29] [V] [TRT] node_of_684 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -5631711556980973584
[11/24/2022-12:12:29] [V] [TRT] Tactic: -5631711556980973584 Time: 5.7882
[11/24/2022-12:12:29] [V] [TRT] Fastest Tactic: 1461874880923808087 Time: 1.78773
[11/24/2022-12:12:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskDeconvolutionV2 Tactic: 1461874880923808087
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,504,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:29] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:29] [V] [TRT] *************** Autotuning format combination: Half(88704,3696,84,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:29] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:29] [V] [TRT] Tactic: 0 Time: 0.118398
[11/24/2022-12:12:29] [V] [TRT] Tactic: 1 Time: 0.118169
[11/24/2022-12:12:29] [V] [TRT] Tactic: 3 Time: 7.96027
[11/24/2022-12:12:29] [V] [TRT] Tactic: 24 Time: 0.280905
[11/24/2022-12:12:29] [V] [TRT] Tactic: 25 Time: 0.268549
[11/24/2022-12:12:30] [V] [TRT] Tactic: 27 Time: 8.39503
[11/24/2022-12:12:30] [V] [TRT] Fastest Tactic: 1 Time: 0.118169
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] Tactic: 0 Time: 0.419186
[11/24/2022-12:12:30] [V] [TRT] Fastest Tactic: 0 Time: 0.419186
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Half(44352,3696:2,84,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,252,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CudnnDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (GemmDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolution)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: node_of_684 (CaskDeconvolutionV2)
[11/24/2022-12:12:30] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:30] [V] [TRT] Tactic: 0 Time: 0.0314459
[11/24/2022-12:12:30] [V] [TRT] Tactic: 1 Time: 0.0283375
[11/24/2022-12:12:30] [V] [TRT] Tactic: 2 Time: 0.0211082
[11/24/2022-12:12:30] [V] [TRT] Tactic: 3 Time: 0.0259604
[11/24/2022-12:12:30] [V] [TRT] Tactic: 4 Time: 0.030155
[11/24/2022-12:12:30] [V] [TRT] Tactic: 5 Time: 0.0207327
[11/24/2022-12:12:30] [V] [TRT] Tactic: 6 Time: 0.0280396
[11/24/2022-12:12:30] [V] [TRT] Tactic: 7 Time: 0.025635
[11/24/2022-12:12:30] [V] [TRT] Tactic: 8 Time: 0.030005
[11/24/2022-12:12:30] [V] [TRT] Tactic: 9 Time: 0.0192543
[11/24/2022-12:12:30] [V] [TRT] Tactic: 28 Time: 0.0317998
[11/24/2022-12:12:30] [V] [TRT] Fastest Tactic: 9 Time: 0.0192543
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:30] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24), Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:30] [V] [TRT] Tactic: 0 Time: 0.0286994
[11/24/2022-12:12:30] [V] [TRT] Tactic: 1 Time: 0.035339
[11/24/2022-12:12:30] [V] [TRT] Tactic: 2 Time: 0.0274606
[11/24/2022-12:12:30] [V] [TRT] Tactic: 3 Time: 0.0266354
[11/24/2022-12:12:30] [V] [TRT] Tactic: 4 Time: 0.0227102
[11/24/2022-12:12:30] [V] [TRT] Tactic: 5 Time: 0.0205897
[11/24/2022-12:12:30] [V] [TRT] Tactic: 6 Time: 0.0280503
[11/24/2022-12:12:30] [V] [TRT] Tactic: 7 Time: 0.0245265
[11/24/2022-12:12:30] [V] [TRT] Tactic: 8 Time: 0.0187131
[11/24/2022-12:12:30] [V] [TRT] Tactic: 9 Time: 0.0269608
[11/24/2022-12:12:30] [V] [TRT] Tactic: 28 Time: 0.0311762
[11/24/2022-12:12:30] [V] [TRT] Fastest Tactic: 8 Time: 0.0187131
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:30] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6), Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:30] [V] [TRT] Tactic: 0 Time: 0.0404686
[11/24/2022-12:12:30] [V] [TRT] Tactic: 1 Time: 0.044032
[11/24/2022-12:12:30] [V] [TRT] Tactic: 2 Time: 0.0613211
[11/24/2022-12:12:30] [V] [TRT] Tactic: 3 Time: 0.0398011
[11/24/2022-12:12:30] [V] [TRT] Tactic: 4 Time: 0.0584823
[11/24/2022-12:12:30] [V] [TRT] Tactic: 5 Time: 0.069795
[11/24/2022-12:12:30] [V] [TRT] Tactic: 6 Time: 0.037144
[11/24/2022-12:12:30] [V] [TRT] Tactic: 7 Time: 0.0436217
[11/24/2022-12:12:30] [V] [TRT] Tactic: 8 Time: 0.062432
[11/24/2022-12:12:30] [V] [TRT] Tactic: 9 Time: 0.0736846
[11/24/2022-12:12:30] [V] [TRT] Tactic: 10 Time: 0.0371726
[11/24/2022-12:12:30] [V] [TRT] Tactic: 11 Time: 0.0335095
[11/24/2022-12:12:30] [V] [TRT] Tactic: 12 Time: 0.0420377
[11/24/2022-12:12:30] [V] [TRT] Tactic: 13 Time: 0.0363017
[11/24/2022-12:12:30] [V] [TRT] Tactic: 14 Time: 0.0424286
[11/24/2022-12:12:30] [V] [TRT] Tactic: 15 Time: 0.062496
[11/24/2022-12:12:30] [V] [TRT] Tactic: 16 Time: 0.0293449
[11/24/2022-12:12:30] [V] [TRT] Tactic: 17 Time: 0.0383543
[11/24/2022-12:12:30] [V] [TRT] Tactic: 18 Time: 0.0567771
[11/24/2022-12:12:30] [V] [TRT] Tactic: 19 Time: 0.0685303
[11/24/2022-12:12:30] [V] [TRT] Tactic: 20 Time: 0.0265227
[11/24/2022-12:12:30] [V] [TRT] Tactic: 21 Time: 0.0300818
[11/24/2022-12:12:30] [V] [TRT] Tactic: 22 Time: 0.034848
[11/24/2022-12:12:30] [V] [TRT] Tactic: 23 Time: 0.0251139
[11/24/2022-12:12:30] [V] [TRT] Tactic: 28 Time: 0.0412949
[11/24/2022-12:12:30] [V] [TRT] Tactic: 29 Time: 0.0341714
[11/24/2022-12:12:30] [V] [TRT] Tactic: 30 Time: 0.0373291
[11/24/2022-12:12:30] [V] [TRT] Fastest Tactic: 23 Time: 0.0251139
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:30] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 23
[11/24/2022-12:12:30] [V] [TRT] *************** Autotuning format combination: Float(14784,14784:32,168,1), Float(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:30] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:30] [V] [TRT] Tactic: 24 Time: 0.0589501
[11/24/2022-12:12:30] [V] [TRT] Tactic: 25 Time: 0.0597379
[11/24/2022-12:12:31] [V] [TRT] Tactic: 26 Time: 0.0605531
[11/24/2022-12:12:31] [V] [TRT] Tactic: 27 Time: 0.0526644
[11/24/2022-12:12:31] [V] [TRT] Tactic: 31 Time: 0.0588175
[11/24/2022-12:12:31] [V] [TRT] Fastest Tactic: 27 Time: 0.0526644
[11/24/2022-12:12:31] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:31] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27
[11/24/2022-12:12:31] [V] [TRT] *************** Autotuning format combination: Float(1:4,14784,168,1), Float(1:4,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:12:31] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:31] [V] [TRT] Tactic: 0 Time: 0.838354
[11/24/2022-12:12:31] [V] [TRT] Tactic: 1 Time: 1.01957
[11/24/2022-12:12:31] [V] [TRT] Tactic: 2 Time: 1.04235
[11/24/2022-12:12:31] [V] [TRT] Tactic: 3 Time: 1.38464
[11/24/2022-12:12:31] [V] [TRT] Tactic: 4 Time: 1.44861
[11/24/2022-12:12:31] [V] [TRT] Tactic: 5 Time: 1.15515
[11/24/2022-12:12:32] [V] [TRT] Tactic: 6 Time: 2.11716
[11/24/2022-12:12:32] [V] [TRT] Tactic: 7 Time: 1.99332
[11/24/2022-12:12:32] [V] [TRT] Tactic: 8 Time: 2.29432
[11/24/2022-12:12:32] [V] [TRT] Tactic: 9 Time: 2.13312
[11/24/2022-12:12:32] [V] [TRT] Tactic: 10 Time: 0.792425
[11/24/2022-12:12:32] [V] [TRT] Tactic: 11 Time: 1.0085
[11/24/2022-12:12:32] [V] [TRT] Tactic: 12 Time: 0.880987
[11/24/2022-12:12:32] [V] [TRT] Tactic: 13 Time: 1.30728
[11/24/2022-12:12:32] [V] [TRT] Tactic: 14 Time: 1.22724
[11/24/2022-12:12:32] [V] [TRT] Tactic: 15 Time: 1.0043
[11/24/2022-12:12:32] [V] [TRT] Tactic: 16 Time: 1.98385
[11/24/2022-12:12:32] [V] [TRT] Tactic: 17 Time: 1.54519
[11/24/2022-12:12:32] [V] [TRT] Tactic: 18 Time: 1.65704
[11/24/2022-12:12:32] [V] [TRT] Tactic: 19 Time: 1.15049
[11/24/2022-12:12:32] [V] [TRT] Tactic: 20 Time: 0.676544
[11/24/2022-12:12:32] [V] [TRT] Tactic: 21 Time: 0.843008
[11/24/2022-12:12:32] [V] [TRT] Tactic: 22 Time: 1.0805
[11/24/2022-12:12:32] [V] [TRT] Tactic: 23 Time: 1.59036
[11/24/2022-12:12:32] [V] [TRT] Tactic: 28 Time: 0.161266
[11/24/2022-12:12:32] [V] [TRT] Tactic: 29 Time: 0.139787
[11/24/2022-12:12:32] [V] [TRT] Tactic: 30 Time: 0.141769
[11/24/2022-12:12:32] [V] [TRT] Fastest Tactic: 29 Time: 0.139787
[11/24/2022-12:12:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29
[11/24/2022-12:12:32] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1), Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:32] [V] [TRT] Tactic: 0 Time: 0.0178215
[11/24/2022-12:12:32] [V] [TRT] Tactic: 1 Time: 0.0146377
[11/24/2022-12:12:32] [V] [TRT] Tactic: 2 Time: 0.0125798
[11/24/2022-12:12:32] [V] [TRT] Tactic: 3 Time: 0.0121916
[11/24/2022-12:12:32] [V] [TRT] Tactic: 4 Time: 0.012307
[11/24/2022-12:12:32] [V] [TRT] Tactic: 5 Time: 0.0115457
[11/24/2022-12:12:32] [V] [TRT] Tactic: 6 Time: 0.0103504
[11/24/2022-12:12:32] [V] [TRT] Tactic: 7 Time: 0.0121021
[11/24/2022-12:12:32] [V] [TRT] Tactic: 8 Time: 0.0101187
[11/24/2022-12:12:32] [V] [TRT] Tactic: 9 Time: 0.0105437
[11/24/2022-12:12:32] [V] [TRT] Tactic: 28 Time: 0.0170011
[11/24/2022-12:12:32] [V] [TRT] Fastest Tactic: 8 Time: 0.0101187
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:32] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
[11/24/2022-12:12:32] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1), Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:32] [V] [TRT] Tactic: 0 Time: 0.0129333
[11/24/2022-12:12:32] [V] [TRT] Tactic: 1 Time: 0.0128164
[11/24/2022-12:12:32] [V] [TRT] Tactic: 2 Time: 0.0136
[11/24/2022-12:12:32] [V] [TRT] Tactic: 3 Time: 0.0143991
[11/24/2022-12:12:32] [V] [TRT] Tactic: 4 Time: 0.0135834
[11/24/2022-12:12:32] [V] [TRT] Tactic: 5 Time: 0.0161519
[11/24/2022-12:12:32] [V] [TRT] Tactic: 6 Time: 0.0140098
[11/24/2022-12:12:32] [V] [TRT] Tactic: 7 Time: 0.0133004
[11/24/2022-12:12:32] [V] [TRT] Tactic: 8 Time: 0.0153403
[11/24/2022-12:12:32] [V] [TRT] Tactic: 9 Time: 0.0229708
[11/24/2022-12:12:32] [V] [TRT] Tactic: 10 Time: 0.0201989
[11/24/2022-12:12:32] [V] [TRT] Tactic: 11 Time: 0.0174207
[11/24/2022-12:12:32] [V] [TRT] Tactic: 12 Time: 0.0156713
[11/24/2022-12:12:32] [V] [TRT] Tactic: 13 Time: 0.0130298
[11/24/2022-12:12:32] [V] [TRT] Tactic: 14 Time: 0.0130045
[11/24/2022-12:12:32] [V] [TRT] Tactic: 15 Time: 0.0126606
[11/24/2022-12:12:32] [V] [TRT] Tactic: 16 Time: 0.0124324
[11/24/2022-12:12:32] [V] [TRT] Tactic: 17 Time: 0.012563
[11/24/2022-12:12:32] [V] [TRT] Tactic: 18 Time: 0.0123383
[11/24/2022-12:12:32] [V] [TRT] Tactic: 19 Time: 0.0124004
[11/24/2022-12:12:32] [V] [TRT] Tactic: 28 Time: 0.0137064
[11/24/2022-12:12:32] [V] [TRT] Tactic: 29 Time: 0.018152
[11/24/2022-12:12:32] [V] [TRT] Fastest Tactic: 18 Time: 0.0123383
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:32] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 18
[11/24/2022-12:12:32] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3), Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:32] [V] [TRT] Tactic: 0 Time: 0.0139399
[11/24/2022-12:12:32] [V] [TRT] Tactic: 1 Time: 0.0158208
[11/24/2022-12:12:32] [V] [TRT] Tactic: 2 Time: 0.0232927
[11/24/2022-12:12:32] [V] [TRT] Tactic: 3 Time: 0.0161158
[11/24/2022-12:12:32] [V] [TRT] Tactic: 4 Time: 0.0157998
[11/24/2022-12:12:32] [V] [TRT] Tactic: 5 Time: 0.0224718
[11/24/2022-12:12:32] [V] [TRT] Tactic: 6 Time: 0.0143689
[11/24/2022-12:12:32] [V] [TRT] Tactic: 7 Time: 0.0133735
[11/24/2022-12:12:32] [V] [TRT] Tactic: 8 Time: 0.0138577
[11/24/2022-12:12:32] [V] [TRT] Tactic: 9 Time: 0.022159
[11/24/2022-12:12:32] [V] [TRT] Tactic: 10 Time: 0.0137292
[11/24/2022-12:12:32] [V] [TRT] Tactic: 11 Time: 0.0132675
[11/24/2022-12:12:32] [V] [TRT] Tactic: 12 Time: 0.0165608
[11/24/2022-12:12:32] [V] [TRT] Tactic: 13 Time: 0.0133502
[11/24/2022-12:12:32] [V] [TRT] Tactic: 14 Time: 0.0154962
[11/24/2022-12:12:32] [V] [TRT] Tactic: 15 Time: 0.0217228
[11/24/2022-12:12:32] [V] [TRT] Tactic: 16 Time: 0.0132663
[11/24/2022-12:12:32] [V] [TRT] Tactic: 17 Time: 0.0131582
[11/24/2022-12:12:32] [V] [TRT] Tactic: 18 Time: 0.017632
[11/24/2022-12:12:32] [V] [TRT] Tactic: 19 Time: 0.0247581
[11/24/2022-12:12:32] [V] [TRT] Tactic: 20 Time: 0.0130922
[11/24/2022-12:12:32] [V] [TRT] Tactic: 21 Time: 0.012997
[11/24/2022-12:12:32] [V] [TRT] Tactic: 22 Time: 0.013807
[11/24/2022-12:12:32] [V] [TRT] Tactic: 23 Time: 0.0156169
[11/24/2022-12:12:32] [V] [TRT] Tactic: 24 Time: 0.0197577
[11/24/2022-12:12:32] [V] [TRT] Tactic: 25 Time: 0.0174994
[11/24/2022-12:12:32] [V] [TRT] Tactic: 26 Time: 0.0133145
[11/24/2022-12:12:32] [V] [TRT] Tactic: 27 Time: 0.0123265
[11/24/2022-12:12:32] [V] [TRT] Tactic: 28 Time: 0.0163124
[11/24/2022-12:12:32] [V] [TRT] Tactic: 29 Time: 0.0131304
[11/24/2022-12:12:32] [V] [TRT] Tactic: 30 Time: 0.0135152
[11/24/2022-12:12:32] [V] [TRT] Tactic: 31 Time: 0.0180651
[11/24/2022-12:12:32] [V] [TRT] Fastest Tactic: 27 Time: 0.0123265
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:32] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27
[11/24/2022-12:12:32] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2), Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:32] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:32] [V] [TRT] Tactic: 10 Time: 0.0601006
[11/24/2022-12:12:33] [V] [TRT] Tactic: 11 Time: 0.0761074
[11/24/2022-12:12:33] [V] [TRT] Tactic: 12 Time: 0.0736251
[11/24/2022-12:12:34] [V] [TRT] Tactic: 13 Time: 0.110455
[11/24/2022-12:12:34] [V] [TRT] Tactic: 14 Time: 0.10317
[11/24/2022-12:12:34] [V] [TRT] Tactic: 15 Time: 0.0722697
[11/24/2022-12:12:35] [V] [TRT] Tactic: 16 Time: 0.176613
[11/24/2022-12:12:35] [V] [TRT] Tactic: 17 Time: 0.12789
[11/24/2022-12:12:35] [V] [TRT] Tactic: 18 Time: 0.149143
[11/24/2022-12:12:36] [V] [TRT] Tactic: 19 Time: 0.102334
[11/24/2022-12:12:36] [V] [TRT] Tactic: 20 Time: 0.0432869
[11/24/2022-12:12:37] [V] [TRT] Tactic: 21 Time: 0.0551406
[11/24/2022-12:12:37] [V] [TRT] Tactic: 22 Time: 0.0739154
[11/24/2022-12:12:37] [V] [TRT] Tactic: 23 Time: 0.11059
[11/24/2022-12:12:37] [V] [TRT] Tactic: 24 Time: 0.0355511
[11/24/2022-12:12:38] [V] [TRT] Tactic: 25 Time: 0.0472469
[11/24/2022-12:12:38] [V] [TRT] Tactic: 26 Time: 0.06224
[11/24/2022-12:12:38] [V] [TRT] Tactic: 27 Time: 0.0933829
[11/24/2022-12:12:39] [V] [TRT] Tactic: 29 Time: 0.0224758
[11/24/2022-12:12:39] [V] [TRT] Tactic: 30 Time: 0.0166375
[11/24/2022-12:12:39] [V] [TRT] Tactic: 31 Time: 0.0212748
[11/24/2022-12:12:39] [V] [TRT] Fastest Tactic: 30 Time: 0.0166375
[11/24/2022-12:12:39] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:39] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 30
[11/24/2022-12:12:39] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:39] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:40] [V] [TRT] Tactic: 20 Time: 0.0192149
[11/24/2022-12:12:40] [V] [TRT] Tactic: 21 Time: 0.0207491
[11/24/2022-12:12:40] [V] [TRT] Tactic: 22 Time: 0.0206589
[11/24/2022-12:12:41] [V] [TRT] Tactic: 23 Time: 0.020433
[11/24/2022-12:12:41] [V] [TRT] Tactic: 24 Time: 0.0170453
[11/24/2022-12:12:41] [V] [TRT] Tactic: 25 Time: 0.0173567
[11/24/2022-12:12:42] [V] [TRT] Tactic: 26 Time: 0.0195469
[11/24/2022-12:12:42] [V] [TRT] Tactic: 27 Time: 0.0200263
[11/24/2022-12:12:42] [V] [TRT] Tactic: 30 Time: 0.0212369
[11/24/2022-12:12:43] [V] [TRT] Tactic: 31 Time: 0.0177173
[11/24/2022-12:12:43] [V] [TRT] Fastest Tactic: 24 Time: 0.0170453
[11/24/2022-12:12:43] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:43] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24
[11/24/2022-12:12:43] [V] [TRT] *************** Autotuning format combination: Half(1:8,14784,168,1), Half(1:8,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:12:43] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:43] [V] [TRT] Tactic: 0 Time: 1.17117
[11/24/2022-12:12:43] [V] [TRT] Tactic: 1 Time: 1.57299
[11/24/2022-12:12:43] [V] [TRT] Tactic: 2 Time: 1.58444
[11/24/2022-12:12:43] [V] [TRT] Tactic: 3 Time: 2.35769
[11/24/2022-12:12:43] [V] [TRT] Tactic: 4 Time: 2.15517
[11/24/2022-12:12:43] [V] [TRT] Tactic: 5 Time: 1.55894
[11/24/2022-12:12:43] [V] [TRT] Tactic: 6 Time: 3.9463
[11/24/2022-12:12:43] [V] [TRT] Tactic: 7 Time: 3.07503
[11/24/2022-12:12:43] [V] [TRT] Tactic: 8 Time: 3.52641
[11/24/2022-12:12:43] [V] [TRT] Tactic: 9 Time: 2.64017
[11/24/2022-12:12:43] [V] [TRT] Tactic: 10 Time: 0.930629
[11/24/2022-12:12:43] [V] [TRT] Tactic: 11 Time: 1.21614
[11/24/2022-12:12:43] [V] [TRT] Tactic: 12 Time: 1.1456
[11/24/2022-12:12:43] [V] [TRT] Tactic: 13 Time: 1.65351
[11/24/2022-12:12:43] [V] [TRT] Tactic: 14 Time: 1.58159
[11/24/2022-12:12:43] [V] [TRT] Tactic: 15 Time: 1.15434
[11/24/2022-12:12:43] [V] [TRT] Tactic: 16 Time: 2.52468
[11/24/2022-12:12:43] [V] [TRT] Tactic: 17 Time: 2.02626
[11/24/2022-12:12:43] [V] [TRT] Tactic: 18 Time: 1.95989
[11/24/2022-12:12:43] [V] [TRT] Tactic: 19 Time: 1.43765
[11/24/2022-12:12:43] [V] [TRT] Tactic: 20 Time: 0.863136
[11/24/2022-12:12:43] [V] [TRT] Tactic: 21 Time: 1.03264
[11/24/2022-12:12:43] [V] [TRT] Tactic: 22 Time: 1.43064
[11/24/2022-12:12:43] [V] [TRT] Tactic: 23 Time: 2.12747
[11/24/2022-12:12:43] [V] [TRT] Tactic: 24 Time: 0.854235
[11/24/2022-12:12:43] [V] [TRT] Tactic: 25 Time: 0.962857
[11/24/2022-12:12:43] [V] [TRT] Tactic: 26 Time: 1.1747
[11/24/2022-12:12:43] [V] [TRT] Tactic: 27 Time: 1.76016
[11/24/2022-12:12:43] [V] [TRT] Tactic: 28 Time: 0.173664
[11/24/2022-12:12:43] [V] [TRT] Tactic: 29 Time: 0.139829
[11/24/2022-12:12:43] [V] [TRT] Tactic: 30 Time: 0.141785
[11/24/2022-12:12:43] [V] [TRT] Tactic: 31 Time: 0.198651
[11/24/2022-12:12:43] [V] [TRT] Fastest Tactic: 29 Time: 0.139829
[11/24/2022-12:12:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 29
[11/24/2022-12:12:43] [V] [TRT] *************** Autotuning format combination: Half(354816:32,14784,168,1), Half(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:12:43] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:43] [V] [TRT] Tactic: 20 Time: 0.627643
[11/24/2022-12:12:43] [V] [TRT] Tactic: 21 Time: 0.591022
[11/24/2022-12:12:43] [V] [TRT] Tactic: 22 Time: 0.598478
[11/24/2022-12:12:43] [V] [TRT] Tactic: 23 Time: 0.602862
[11/24/2022-12:12:43] [V] [TRT] Tactic: 24 Time: 0.537577
[11/24/2022-12:12:44] [V] [TRT] Tactic: 25 Time: 0.535794
[11/24/2022-12:12:44] [V] [TRT] Tactic: 26 Time: 0.537682
[11/24/2022-12:12:44] [V] [TRT] Tactic: 27 Time: 0.53835
[11/24/2022-12:12:44] [V] [TRT] Tactic: 30 Time: 0.626761
[11/24/2022-12:12:44] [V] [TRT] Tactic: 31 Time: 0.537563
[11/24/2022-12:12:44] [V] [TRT] Fastest Tactic: 25 Time: 0.535794
[11/24/2022-12:12:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25
[11/24/2022-12:12:44] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784,168,1), Int8(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:12:44] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:44] [V] [TRT] Tactic: 0 Time: 0.0204807
[11/24/2022-12:12:44] [V] [TRT] Tactic: 1 Time: 0.0179349
[11/24/2022-12:12:44] [V] [TRT] Tactic: 2 Time: 0.0153618
[11/24/2022-12:12:44] [V] [TRT] Tactic: 3 Time: 0.0151365
[11/24/2022-12:12:44] [V] [TRT] Tactic: 4 Time: 0.0128651
[11/24/2022-12:12:44] [V] [TRT] Tactic: 5 Time: 0.0124301
[11/24/2022-12:12:44] [V] [TRT] Tactic: 6 Time: 0.0124114
[11/24/2022-12:12:44] [V] [TRT] Tactic: 7 Time: 0.0123661
[11/24/2022-12:12:44] [V] [TRT] Tactic: 8 Time: 0.0121623
[11/24/2022-12:12:44] [V] [TRT] Tactic: 9 Time: 0.0121893
[11/24/2022-12:12:44] [V] [TRT] Tactic: 28 Time: 0.0179874
[11/24/2022-12:12:44] [V] [TRT] Fastest Tactic: 8 Time: 0.0121623
[11/24/2022-12:12:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8
[11/24/2022-12:12:44] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1), Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:44] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:44] [V] [TRT] Tactic: 0 Time: 0.0123973
[11/24/2022-12:12:44] [V] [TRT] Tactic: 1 Time: 0.0121874
[11/24/2022-12:12:44] [V] [TRT] Tactic: 2 Time: 0.0120076
[11/24/2022-12:12:44] [V] [TRT] Tactic: 3 Time: 0.0120552
[11/24/2022-12:12:44] [V] [TRT] Tactic: 4 Time: 0.0117169
[11/24/2022-12:12:44] [V] [TRT] Tactic: 5 Time: 0.010462
[11/24/2022-12:12:44] [V] [TRT] Tactic: 6 Time: 0.0121421
[11/24/2022-12:12:44] [V] [TRT] Tactic: 7 Time: 0.0120175
[11/24/2022-12:12:44] [V] [TRT] Tactic: 8 Time: 0.012155
[11/24/2022-12:12:44] [V] [TRT] Tactic: 9 Time: 0.0132056
[11/24/2022-12:12:44] [V] [TRT] Tactic: 10 Time: 0.0178651
[11/24/2022-12:12:44] [V] [TRT] Tactic: 11 Time: 0.0152265
[11/24/2022-12:12:44] [V] [TRT] Tactic: 12 Time: 0.0150807
[11/24/2022-12:12:44] [V] [TRT] Tactic: 13 Time: 0.0126408
[11/24/2022-12:12:44] [V] [TRT] Tactic: 14 Time: 0.0153335
[11/24/2022-12:12:44] [V] [TRT] Tactic: 15 Time: 0.0151461
[11/24/2022-12:12:44] [V] [TRT] Tactic: 16 Time: 0.0125585
[11/24/2022-12:12:44] [V] [TRT] Tactic: 17 Time: 0.0153417
[11/24/2022-12:12:44] [V] [TRT] Tactic: 18 Time: 0.0152672
[11/24/2022-12:12:44] [V] [TRT] Tactic: 19 Time: 0.0157865
[11/24/2022-12:12:44] [V] [TRT] Tactic: 20 Time: 0.0233143
[11/24/2022-12:12:44] [V] [TRT] Tactic: 21 Time: 0.0180406
[11/24/2022-12:12:44] [V] [TRT] Tactic: 22 Time: 0.0152069
[11/24/2022-12:12:44] [V] [TRT] Tactic: 23 Time: 0.012757
[11/24/2022-12:12:44] [V] [TRT] Tactic: 28 Time: 0.0178281
[11/24/2022-12:12:44] [V] [TRT] Tactic: 29 Time: 0.0204
[11/24/2022-12:12:44] [V] [TRT] Tactic: 30 Time: 0.0231556
[11/24/2022-12:12:44] [V] [TRT] Fastest Tactic: 5 Time: 0.010462
[11/24/2022-12:12:44] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:44] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5
[11/24/2022-12:12:44] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:44] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:44] [V] [TRT] Tactic: 10 Time: 0.0138103
[11/24/2022-12:12:45] [V] [TRT] Tactic: 11 Time: 0.0147346
[11/24/2022-12:12:45] [V] [TRT] Tactic: 12 Time: 0.0152773
[11/24/2022-12:12:45] [V] [TRT] Tactic: 13 Time: 0.0150098
[11/24/2022-12:12:46] [V] [TRT] Tactic: 14 Time: 0.013423
[11/24/2022-12:12:46] [V] [TRT] Tactic: 15 Time: 0.0161194
[11/24/2022-12:12:47] [V] [TRT] Tactic: 16 Time: 0.0176559
[11/24/2022-12:12:47] [V] [TRT] Tactic: 17 Time: 0.0153509
[11/24/2022-12:12:48] [V] [TRT] Tactic: 18 Time: 0.0181583
[11/24/2022-12:12:48] [V] [TRT] Tactic: 19 Time: 0.0192617
[11/24/2022-12:12:49] [V] [TRT] Tactic: 20 Time: 0.0151538
[11/24/2022-12:12:49] [V] [TRT] Tactic: 21 Time: 0.0133802
[11/24/2022-12:12:49] [V] [TRT] Tactic: 22 Time: 0.0152983
[11/24/2022-12:12:50] [V] [TRT] Tactic: 23 Time: 0.0206642
[11/24/2022-12:12:50] [V] [TRT] Tactic: 24 Time: 0.0524785
[11/24/2022-12:12:50] [V] [TRT] Tactic: 25 Time: 0.0788823
[11/24/2022-12:12:51] [V] [TRT] Tactic: 26 Time: 0.0727291
[11/24/2022-12:12:51] [V] [TRT] Tactic: 27 Time: 0.0741234
[11/24/2022-12:12:51] [V] [TRT] Tactic: 29 Time: 0.477719
[11/24/2022-12:12:52] [V] [TRT] Tactic: 30 Time: 0.255451
[11/24/2022-12:12:52] [V] [TRT] Tactic: 31 Time: 0.2992
[11/24/2022-12:12:52] [V] [TRT] Fastest Tactic: 21 Time: 0.0133802
[11/24/2022-12:12:52] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWise)
[11/24/2022-12:12:52] [V] [TRT] PointWise has no valid tactics for this config, skipping
[11/24/2022-12:12:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 21
[11/24/2022-12:12:52] [V] [TRT] *************** Autotuning format combination: Int8(354816:32,14784,168,1), Int8(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:12:52] [V] [TRT] --------------- Timing Runner: PWN(node_of_685) (PointWiseV2)
[11/24/2022-12:12:52] [V] [TRT] Tactic: 10 Time: 2.30259
[11/24/2022-12:12:52] [V] [TRT] Tactic: 11 Time: 2.22197
[11/24/2022-12:12:52] [V] [TRT] Tactic: 12 Time: 2.3443
[11/24/2022-12:12:52] [V] [TRT] Tactic: 13 Time: 1.19772
[11/24/2022-12:12:52] [V] [TRT] Tactic: 14 Time: 1.18969
[11/24/2022-12:12:52] [V] [TRT] Tactic: 15 Time: 1.29349
[11/24/2022-12:12:52] [V] [TRT] Tactic: 16 Time: 1.21307
[11/24/2022-12:12:52] [V] [TRT] Tactic: 17 Time: 1.19712
[11/24/2022-12:12:52] [V] [TRT] Tactic: 18 Time: 1.36883
[11/24/2022-12:12:52] [V] [TRT] Tactic: 19 Time: 1.72102
[11/24/2022-12:12:52] [V] [TRT] Tactic: 20 Time: 1.43805
[11/24/2022-12:12:52] [V] [TRT] Tactic: 21 Time: 1.43399
[11/24/2022-12:12:52] [V] [TRT] Tactic: 22 Time: 1.43573
[11/24/2022-12:12:52] [V] [TRT] Tactic: 23 Time: 1.42334
[11/24/2022-12:12:52] [V] [TRT] Tactic: 24 Time: 1.73516
[11/24/2022-12:12:52] [V] [TRT] Tactic: 25 Time: 1.2895
[11/24/2022-12:12:53] [V] [TRT] Tactic: 26 Time: 1.2343
[11/24/2022-12:12:53] [V] [TRT] Tactic: 27 Time: 1.24323
[11/24/2022-12:12:53] [V] [TRT] Tactic: 29 Time: 7.92576
[11/24/2022-12:12:53] [V] [TRT] Tactic: 30 Time: 1.70931
[11/24/2022-12:12:53] [V] [TRT] Tactic: 31 Time: 1.00995
[11/24/2022-12:12:53] [V] [TRT] Fastest Tactic: 31 Time: 1.00995
[11/24/2022-12:12:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31
[11/24/2022-12:12:53] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:53] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:53] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudaDepthwiseConvolution)
[11/24/2022-12:12:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:53] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (FusedConvActConvolution)
[11/24/2022-12:12:53] [V] [TRT] Tactic: 589823 Time: 0.277659
[11/24/2022-12:12:53] [V] [TRT] Tactic: 655359 Time: 0.206711
[11/24/2022-12:12:53] [V] [TRT] Tactic: 786431 Time: 0.247474
[11/24/2022-12:12:53] [V] [TRT] Tactic: 851967 Time: 0.23232
[11/24/2022-12:12:53] [V] [TRT] Tactic: 1638399 Time: 0.232421
[11/24/2022-12:12:53] [V] [TRT] Tactic: 3538943 Time: 0.223287
[11/24/2022-12:12:53] [V] [TRT] Tactic: 3932159 Time: 0.25045
[11/24/2022-12:12:53] [V] [TRT] Tactic: 4194303 Time: 0.280256
[11/24/2022-12:12:53] [V] [TRT] Tactic: 4980735 Time: 0.280023
[11/24/2022-12:12:53] [V] [TRT] Tactic: 5242879 Time: 0.247703
[11/24/2022-12:12:53] [V] [TRT] Tactic: 5570559 Time: 0.199502
[11/24/2022-12:12:53] [V] [TRT] Tactic: 5767167 Time: 0.386912
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6225919 Time: 0.238514
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6815743 Time: 0.252105
[11/24/2022-12:12:53] [V] [TRT] Tactic: 7077887 Time: 0.226053
[11/24/2022-12:12:53] [V] [TRT] Tactic: 7143423 Time: 0.310853
[11/24/2022-12:12:53] [V] [TRT] Tactic: 7208959 Time: 0.235657
[11/24/2022-12:12:53] [V] [TRT] Tactic: 7536639 Time: 0.261198
[11/24/2022-12:12:53] [V] [TRT] Tactic: 7733247 Time: 0.200105
[11/24/2022-12:12:53] [V] [TRT] Tactic: 8191999 Time: 0.301586
[11/24/2022-12:12:53] [V] [TRT] Tactic: 8716287 Time: 0.245051
[11/24/2022-12:12:53] [V] [TRT] Tactic: 10747903 Time: 0.202167
[11/24/2022-12:12:53] [V] [TRT] Fastest Tactic: 5570559 Time: 0.199502
[11/24/2022-12:12:53] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudnnConvolution)
[11/24/2022-12:12:53] [V] [TRT] Tactic: 0 Time: 0.119531
[11/24/2022-12:12:53] [V] [TRT] Tactic: 1 Time: 0.0916
[11/24/2022-12:12:53] [V] [TRT] Tactic: 2 Time: 0.160718
[11/24/2022-12:12:53] [V] [TRT] Tactic: 4 Time: 11.9394
[11/24/2022-12:12:53] [V] [TRT] Tactic: 5 Time: 0.242537
[11/24/2022-12:12:53] [V] [TRT] Tactic: 56 Time: 0.0677455
[11/24/2022-12:12:53] [V] [TRT] Tactic: 57 Time: 0.0669897
[11/24/2022-12:12:53] [V] [TRT] Tactic: 58 Time: 0.0981211
[11/24/2022-12:12:53] [V] [TRT] Tactic: 60 Time: 10.497
[11/24/2022-12:12:53] [V] [TRT] Tactic: 61 Time: 0.226391
[11/24/2022-12:12:53] [V] [TRT] Tactic: 112 Time: 0.0594331
[11/24/2022-12:12:53] [V] [TRT] Tactic: 113 Time: 0.0582674
[11/24/2022-12:12:53] [V] [TRT] Tactic: 114 Time: 0.0882491
[11/24/2022-12:12:53] [V] [TRT] Tactic: 116 Time: 9.79054
[11/24/2022-12:12:53] [V] [TRT] Tactic: 117 Time: 0.192096
[11/24/2022-12:12:53] [V] [TRT] Fastest Tactic: 113 Time: 0.0582674
[11/24/2022-12:12:53] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:53] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:12:53] [V] [TRT] Tactic: 621442388677115936 Time: 0.132377
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:12:53] [V] [TRT] Tactic: 697756878388249475 Time: 0.0594743
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:12:53] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0605242
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:12:53] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0726423
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:12:53] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0480609
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:12:53] [V] [TRT] Tactic: 2310520233542099555 Time: 0.128549
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:12:53] [V] [TRT] Tactic: 3377996665278764661 Time: 0.188818
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:12:53] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0737143
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:12:53] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0384091
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:12:53] [V] [TRT] Tactic: 4918658762935651592 Time: 0.132286
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:12:53] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0685623
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:12:53] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0842034
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6166883504066133838 Time: 0.104283
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0575741
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0838697
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0495451
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6868013466259746979 Time: 0.103993
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:12:53] [V] [TRT] Tactic: 6901214267543238617 Time: 0.083392
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:12:53] [V] [TRT] Tactic: 8048119769507926928 Time: 0.129506
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:12:53] [V] [TRT] Tactic: 9151672657204310840 Time: 0.072736
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:12:53] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0747246
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:12:53] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0524876
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:12:53] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0538758
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:12:53] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0230727
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:12:53] [V] [TRT] Tactic: -7145578994937510651 Time: 0.0979794
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:12:53] [V] [TRT] Tactic: -7070045993088702524 Time: 0.176814
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:12:53] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0652602
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:12:53] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0269173
[11/24/2022-12:12:53] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:12:53] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0688747
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4562045946847239058 Time: 0.0964686
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0376114
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2777237991111865351 Time: 0.134386
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0572175
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1349585930542925704 Time: 0.101147
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0697707
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:12:54] [V] [TRT] Tactic: -701551393537224327 Time: 0.0401863
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3258434593395023 Time: 0.0871474
[11/24/2022-12:12:54] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0230727
[11/24/2022-12:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1162498931361159915 Time: 0.074816
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1663866669559596164 Time: 0.055552
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0476312
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0446194
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0387989
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0404274
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0481768
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5778138195697110003 Time: 0.0563032
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0426217
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0552716
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0431943
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0466023
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0444491
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0726057
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0384034
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0422137
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0571185
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0545158
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:12:54] [V] [TRT] Tactic: -504296718212024303 Time: 0.0562423
[11/24/2022-12:12:54] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0384034
[11/24/2022-12:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0367177
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0304247
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3119404851233737725 Time: 0.0322944
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5108195418077987197 Time: 0.0457211
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0394263
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0274248
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6031243482516294286 Time: 0.04976
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0390023
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0682514
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0563383
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:12:54] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0456309
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8853476220903838035 Time: 0.0398206
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0353783
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0522773
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0416309
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5033173285090644307 Time: 0.0524602
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0472331
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0705813
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0441314
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0375029
[11/24/2022-12:12:54] [V] [TRT] Fastest Tactic: 5610788582700027969 Time: 0.0274248
[11/24/2022-12:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5610788582700027969
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudnnConvolution)
[11/24/2022-12:12:54] [V] [TRT] Tactic: 0 Time: 0.0532282
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1 Time: 0.0611337
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2 Time: 0.0960594
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4 Time: 9.14555
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5 Time: 0.173618
[11/24/2022-12:12:54] [V] [TRT] Tactic: 56 Time: 0.0507383
[11/24/2022-12:12:54] [V] [TRT] Tactic: 58 Time: 0.0943223
[11/24/2022-12:12:54] [V] [TRT] Tactic: 60 Time: 7.40618
[11/24/2022-12:12:54] [V] [TRT] Tactic: 61 Time: 0.189806
[11/24/2022-12:12:54] [V] [TRT] Fastest Tactic: 56 Time: 0.0507383
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (FusedConvActConvolution)
[11/24/2022-12:12:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0204434
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0687528
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0308361
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0285562
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0285851
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:12:54] [V] [TRT] Tactic: 7392644644614664811 Time: 0.01798
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4884039206922900293 Time: 0.049699
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0201977
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0686004
[11/24/2022-12:12:54] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.01798
[11/24/2022-12:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudaDepthwiseConvolution)
[11/24/2022-12:12:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:12:54] [V] [TRT] Tactic: 254850674756030979 Time: 0.0327598
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0347008
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0265722
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0330432
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 1236070762725864170
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1236070762725864170 Time: 0.015877
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 1297835561412423383
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1297835561412423383 Time: 0.0179371
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0160869
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 1484051751570462061
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1484051751570462061 Time: 0.0183
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0752686
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 1710761387006445904
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1710761387006445904 Time: 0.0202406
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 1788275858806332606
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1788275858806332606 Time: 0.0158098
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0402926
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1838082074606840426 Time: 0.026573
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 1876080869840372148
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1876080869840372148 Time: 0.0135626
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0687314
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:12:54] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0434389
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 2014386895388196995
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2014386895388196995 Time: 0.0115256
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0456754
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 2285052789339973171
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2285052789339973171 Time: 0.0138747
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0286693
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0475589
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0662476
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 2885411890874123330
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2885411890874123330 Time: 0.0119497
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:12:54] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0277714
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 3014367713063089410
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3014367713063089410 Time: 0.0139628
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3071479995783211391 Time: 0.022607
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 3094146840800930111
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3094146840800930111 Time: 0.0160655
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 3111630609330706559
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3111630609330706559 Time: 0.0158757
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 3293261797412283333
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3293261797412283333 Time: 0.0139865
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 3355662717192093688
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3355662717192093688 Time: 0.0178367
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0147218
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0474091
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0348507
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0328393
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 3821081349796384238
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3821081349796384238 Time: 0.0156878
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0244244
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 3900825777106964947
[11/24/2022-12:12:54] [V] [TRT] Tactic: 3900825777106964947 Time: 0.0181291
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0624381
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4370476717970497892 Time: 0.0140592
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0186937
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0273371
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4528997467275241200 Time: 0.0160721
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0287232
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0330066
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4595173549602041350 Time: 0.04708
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4802447371470387646 Time: 0.028461
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:12:54] [V] [TRT] Tactic: 4993757826442493905 Time: 0.0181766
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0327003
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5070322914990170527 Time: 0.032939
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0285952
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0412526
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:12:54] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0286738
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 6006391580592745401
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6006391580592745401 Time: 0.0287598
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0390983
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0335177
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 6373920594237855975
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6373920594237855975 Time: 0.0223301
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0454811
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0454171
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 6580047526417007834
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6580047526417007834 Time: 0.0224581
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6697277555581639516 Time: 0.0266804
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0718857
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:12:54] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0390766
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:12:54] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0165257
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:12:54] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0245989
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 7671477676541500689
[11/24/2022-12:12:54] [V] [TRT] Tactic: 7671477676541500689 Time: 0.0265448
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0267878
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0434251
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0434423
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 8270193703352283962
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8270193703352283962 Time: 0.0135219
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 8609386743006631101
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8609386743006631101 Time: 0.0115988
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 8612200391988441496
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8612200391988441496 Time: 0.0119128
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0287954
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8823554289762712606 Time: 0.0205956
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:12:54] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0161671
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:12:54] [V] [TRT] Tactic: -9203179519031456182 Time: 0.013647
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:12:54] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0286327
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0602484
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8280443484414412687 Time: 0.031051
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0286208
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0223909
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -8006601114930636709
[11/24/2022-12:12:54] [V] [TRT] Tactic: -8006601114930636709 Time: 0.0158908
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -7798149971944012698
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7798149971944012698 Time: 0.0138834
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -7683747554614165540
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7683747554614165540 Time: 0.0159304
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -7604212447063563295
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7604212447063563295 Time: 0.0134325
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -7528383910611180842
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7528383910611180842 Time: 0.0114033
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -7428355835493435592
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7428355835493435592 Time: 0.0201269
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0641493
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -7109456194156851009
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7109456194156851009 Time: 0.0158528
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0271162
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:12:54] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0539032
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: -6789949785717718640
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6789949785717718640 Time: 0.0141482
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6768327495007644783 Time: 0.024544
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: -6594872535430699497
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6594872535430699497 Time: 0.0118488
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: -6510960431881136297
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6510960431881136297 Time: 0.0138992
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0706956
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:12:54] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0389177
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0287205
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0138223
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0282088
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5161596964442251102 Time: 0.047608
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0392023
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0348325
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -5082750115275722821
[11/24/2022-12:12:54] [V] [TRT] Tactic: -5082750115275722821 Time: 0.0157541
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0263345
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0767657
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0413371
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0245067
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4293222705763522367 Time: 0.037024
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0335205
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:12:54] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0641539
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0791154
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0301742
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0180263
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0185109
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0384023
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3234716536615144018 Time: 0.0245029
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0327205
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: -3168858964887995726
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3168858964887995726 Time: 0.0209822
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:12:54] [V] [TRT] Tactic: -3058330359340425555 Time: 0.047256
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0165857
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0438377
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -2590123377344686639
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2590123377344686639 Time: 0.0290158
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -2365592821493052948
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2365592821493052948 Time: 0.0306505
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2353603993968373338 Time: 0.026579
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0414343
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:12:54] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0377154
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0201457
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: -1935873158869965959
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1935873158869965959 Time: 0.0292919
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: -1871293198177288380
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1871293198177288380 Time: 0.0286217
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1828674067637788567 Time: 0.0209959
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0265752
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0246286
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0603078
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0561006
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:12:54] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0364686
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: -563413451241559339
[11/24/2022-12:12:54] [V] [TRT] Tactic: -563413451241559339 Time: 0.0163236
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: -517813403956506640
[11/24/2022-12:12:54] [V] [TRT] Tactic: -517813403956506640 Time: 0.0160274
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:12:54] [V] [TRT] Tactic: -406984317033388136 Time: 0.0316937
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: -356933163344202008
[11/24/2022-12:12:54] [V] [TRT] Tactic: -356933163344202008 Time: 0.0123958
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:12:54] [V] [TRT] Tactic: -331499326992534460 Time: 0.0254179
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: -291069119579384883
[11/24/2022-12:12:54] [V] [TRT] Tactic: -291069119579384883 Time: 0.0127341
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:12:54] [V] [TRT] Tactic: -206523504474952360 Time: 0.0399806
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: -175265966321316526
[11/24/2022-12:12:54] [V] [TRT] Tactic: -175265966321316526 Time: 0.0173907
[11/24/2022-12:12:54] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: -93196984589102737
[11/24/2022-12:12:54] [V] [TRT] Tactic: -93196984589102737 Time: 0.0125794
[11/24/2022-12:12:54] [V] [TRT] Fastest Tactic: -7528383910611180842 Time: 0.0114033
[11/24/2022-12:12:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7528383910611180842
[11/24/2022-12:12:54] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:54] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CublasConvolution)
[11/24/2022-12:12:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudaDepthwiseConvolution)
[11/24/2022-12:12:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:12:55] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0535802
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0533638
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0545112
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0240282
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0292654
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0175304
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0298944
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4443833619060044580 Time: 0.022095
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:12:55] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0187057
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0234429
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:12:55] [V] [TRT] Tactic: -108011214168778087 Time: 0.0186463
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:12:55] [V] [TRT] Tactic: -42427192380281294 Time: 0.0287159
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0175304
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudaDepthwiseConvolution)
[11/24/2022-12:12:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (FusedConvActConvolution)
[11/24/2022-12:12:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:12:55] [V] [TRT] Tactic: 175853789719975416 Time: 0.015099
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0177575
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2234457234705232274 Time: 0.021246
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5834048089706882838 Time: 0.022494
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0369954
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6341572697076960911 Time: 0.017251
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0150496
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8498217049614706532 Time: 0.020862
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0175264
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0386514
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3326139578711341011 Time: 0.0151291
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:12:55] [V] [TRT] Tactic: -683636008127039856 Time: 0.0374069
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: -8626990807754934295 Time: 0.0150496
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8626990807754934295
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:12:55] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0150181
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0360194
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0210358
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:12:55] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0367806
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0208294
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0148544
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0171429
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0369189
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3958182351168863467 Time: 0.017664
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0176935
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1492575840277333548 Time: 0.0152411
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:12:55] [V] [TRT] Tactic: -868495160148524802 Time: 0.0208353
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: -6934773036503365000 Time: 0.0148544
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6934773036503365000
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0208483
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0224927
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0229603
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0208483
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2185926646498217601 Time: 0.0237074
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0191566
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0190531
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:12:55] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0235958
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0322834
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0303314
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0188126
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0401886
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0219507
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7869897696365535632 Time: 0.01962
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7970271430402365872 Time: 0.0236976
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8584126525867982141 Time: 0.0194263
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0263269
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0257356
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0274263
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0294848
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0371943
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0316718
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7633993163187901093 Time: 0.0191726
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0235768
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7282232519526877434 Time: 0.032128
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7007036200777870226 Time: 0.0181109
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6406011580107094428 Time: 0.019976
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0236878
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5416590980288859834 Time: 0.029525
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4704615512436071369 Time: 0.0212402
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0299246
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3644377136375731441 Time: 0.024595
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0237009
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:12:55] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0233254
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0267787
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:12:55] [V] [TRT] Tactic: -621838502160440068 Time: 0.0244655
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: -7007036200777870226 Time: 0.0181109
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7007036200777870226
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:12:55] [V] [TRT] Tactic: 424230345342282109 Time: 0.0184446
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2088124366723311762 Time: 0.013482
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0291319
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0180829
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:12:55] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0329307
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0219513
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0244312
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0287826
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0140659
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0328795
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0250895
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7796695344726998947 Time: 0.0241227
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0224398
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8440932616520880415 Time: 0.0140925
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8471142395703548718 Time: 0.0157783
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:12:55] [V] [TRT] Tactic: 9072692108481390634 Time: 0.0203737
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8897233019398469012 Time: 0.02014
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8732118422363495199 Time: 0.0123371
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8206171403568243244 Time: 0.0160701
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0182137
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6733478368603461850 Time: 0.01808
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0222772
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6079719874915919252 Time: 0.0371429
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0181411
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0137488
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0168147
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3556614738549917282 Time: 0.028096
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0424457
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:12:55] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0152494
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0323282
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0183657
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:12:55] [V] [TRT] Tactic: -50323486981480818 Time: 0.0182989
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: -8732118422363495199 Time: 0.0123371
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8732118422363495199
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudaGroupConvolution)
[11/24/2022-12:12:55] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CudaDepthwiseConvolution)
[11/24/2022-12:12:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (FusedConvActConvolution)
[11/24/2022-12:12:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:55] [V] [TRT] --------------- Timing Runner: node_of_686 + node_of_687 + node_of_688 (CaskConvolution)
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:12:55] [V] [TRT] Tactic: 125145153013230687 Time: 0.036304
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:12:55] [V] [TRT] Tactic: 1583811548148740665 Time: 0.0314386
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:12:55] [V] [TRT] Tactic: 1701344857577810806 Time: 0.0233757
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:12:55] [V] [TRT] Tactic: 1797231177354918208 Time: 0.0124114
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:12:55] [V] [TRT] Tactic: 2756291002030759362 Time: 0.0153632
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3043273137345374664 Time: 0.023234
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3538565962642681625 Time: 0.0179874
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:12:55] [V] [TRT] Tactic: 3593397928177382100 Time: 0.0207608
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:12:55] [V] [TRT] Tactic: 4112572034735311841 Time: 0.015163
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:12:55] [V] [TRT] Tactic: 4610760414797216079 Time: 0.0243177
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:12:55] [V] [TRT] Tactic: 4796956614760326119 Time: 0.018136
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5204702486885981735 Time: 0.0148416
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5443897483205284103 Time: 0.0207164
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5707566217891294846 Time: 0.0149527
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:12:55] [V] [TRT] Tactic: 5986622376339202983 Time: 0.0232202
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6007888770437705057 Time: 0.025933
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6405251167055673379 Time: 0.0205538
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6433368103202497147 Time: 0.0151653
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6441948709525127755 Time: 0.0232718
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6443933097134654777 Time: 0.041816
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6457435868048963632 Time: 0.026029
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6793988781414507278 Time: 0.0206132
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6925201228918187099 Time: 0.0233456
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:12:55] [V] [TRT] Tactic: 6991524515605108718 Time: 0.0288091
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:12:55] [V] [TRT] Tactic: 7318929579222925725 Time: 0.0152512
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8142283985160822229 Time: 0.0234149
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0396503
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0259482
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8524082966802584889 Time: 0.0210162
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:12:55] [V] [TRT] Tactic: 8765382722978397630 Time: 0.0235089
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:12:55] [V] [TRT] Tactic: -8638624340850784688 Time: 0.0235722
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:12:55] [V] [TRT] Tactic: -7844028314176826857 Time: 0.0234279
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6879607992933502380 Time: 0.0148041
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6510232214299595844 Time: 0.0149522
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:12:55] [V] [TRT] Tactic: -6232597026469067819 Time: 0.0233691
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5671123121710113970 Time: 0.021647
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5562968047117507056 Time: 0.0233104
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:12:55] [V] [TRT] Tactic: -5516472881360101487 Time: 0.0217744
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4455415102719506646 Time: 0.0176863
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4425346730823666456 Time: 0.0215928
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4182501876984672402 Time: 0.0233646
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:12:55] [V] [TRT] Tactic: -4151617293257698859 Time: 0.0450377
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3825889760337461729 Time: 0.0128411
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3613322253849278738 Time: 0.0152087
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:12:55] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0342354
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:12:55] [V] [TRT] Tactic: -2754311112012636251 Time: 0.0125196
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:12:55] [V] [TRT] Tactic: -2432868635536396215 Time: 0.0297856
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:12:55] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0425234
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1916483171117495388 Time: 0.0262507
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1549742793039499659 Time: 0.0259307
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1328736756812546664 Time: 0.0259352
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:12:55] [V] [TRT] Tactic: -1006589727652607355 Time: 0.012301
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:12:55] [V] [TRT] Tactic: -405554772060757402 Time: 0.0152891
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:12:55] [V] [TRT] Tactic: -375949437730908730 Time: 0.0177773
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:12:55] [V] [TRT] Tactic: -111878368089469751 Time: 0.0213858
[11/24/2022-12:12:55] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:12:55] [V] [TRT] Tactic: -19707840769375107 Time: 0.0119505
[11/24/2022-12:12:55] [V] [TRT] Fastest Tactic: -19707840769375107 Time: 0.0119505
[11/24/2022-12:12:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -19707840769375107
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,3696,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1,2016,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,504,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(88704,3696,84,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,3696:2,84,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,252,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24), Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6), Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(14784,14784:32,168,1), Float(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(1:4,14784,168,1), Float(1:4,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1), Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1), Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3), Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2), Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(1:8,14784,168,1), Half(1:8,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816:32,14784,168,1), Half(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784,168,1), Int8(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1), Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(354816:32,14784,168,1), Int8(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,3696,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1,2016,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,504,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(88704,3696,84,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,3696:2,84,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,252,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24), Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6), Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(14784,14784:32,168,1), Float(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(1:4,14784,168,1), Float(1:4,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1), Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1), Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3), Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2), Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(1:8,14784,168,1), Half(1:8,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816:32,14784,168,1), Half(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784,168,1), Int8(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1), Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(354816:32,14784,168,1), Int8(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(118272,3696,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(118272,1,2688,32) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(29568,1:4,672,8) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(118272,3696,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(59136,3696:2,84,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,336,4) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(29568,3696:4,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,3696,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1,2016,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,504,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(88704,3696,84,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,3696:2,84,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,252,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24), Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6), Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(14784,14784:32,168,1), Float(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(1:4,14784,168,1), Float(1:4,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1), Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1), Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3), Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2), Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(1:8,14784,168,1), Half(1:8,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816:32,14784,168,1), Half(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784,168,1), Int8(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1), Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(354816:32,14784,168,1), Int8(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:55] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:56] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Float(88704,924,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudaDepthwiseConvolution)
[11/24/2022-12:12:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (FusedConvActConvolution)
[11/24/2022-12:12:56] [V] [TRT] Tactic: 589823 Time: 0.0354304
[11/24/2022-12:12:56] [V] [TRT] Tactic: 655359 Time: 0.0286967
[11/24/2022-12:12:56] [V] [TRT] Tactic: 786431 Time: 0.0154354
[11/24/2022-12:12:56] [V] [TRT] Tactic: 851967 Time: 0.0234403
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1179647 Time: 0.0180834
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1638399 Time: 0.0151237
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2097151 Time: 0.0152649
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3538943 Time: 0.0150757
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3932159 Time: 0.0244114
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3997695 Time: 0.0150057
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4194303 Time: 0.017868
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4259839 Time: 0.0152549
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4587519 Time: 0.0147726
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4653055 Time: 0.0180274
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4915199 Time: 0.014971
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4980735 Time: 0.0179743
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5177343 Time: 0.0179417
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5242879 Time: 0.0177834
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5373951 Time: 0.0191457
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5570559 Time: 0.0207889
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5767167 Time: 0.0206994
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5898239 Time: 0.0182509
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6225919 Time: 0.0152375
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6291455 Time: 0.0179137
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6815743 Time: 0.018
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7012351 Time: 0.0152823
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7077887 Time: 0.0155817
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7143423 Time: 0.0180063
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7208959 Time: 0.0179686
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7340031 Time: 0.0201846
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7536639 Time: 0.0232287
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7733247 Time: 0.0153751
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8191999 Time: 0.0152082
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8716287 Time: 0.0179846
[11/24/2022-12:12:56] [V] [TRT] Tactic: 9109503 Time: 0.0177077
[11/24/2022-12:12:56] [V] [TRT] Tactic: 9568255 Time: 0.0149778
[11/24/2022-12:12:56] [V] [TRT] Tactic: 10354687 Time: 0.0152635
[11/24/2022-12:12:56] [V] [TRT] Tactic: 10747903 Time: 0.0152969
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0147726
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudnnConvolution)
[11/24/2022-12:12:56] [V] [TRT] Tactic: 0 Time: 0.0489691
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1 Time: 0.0541653
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2 Time: 0.103792
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4 Time: 1.42486
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5 Time: 0.119737
[11/24/2022-12:12:56] [V] [TRT] Tactic: 56 Time: 0.0469337
[11/24/2022-12:12:56] [V] [TRT] Tactic: 57 Time: 0.0486339
[11/24/2022-12:12:56] [V] [TRT] Tactic: 58 Time: 0.104279
[11/24/2022-12:12:56] [V] [TRT] Tactic: 60 Time: 1.45101
[11/24/2022-12:12:56] [V] [TRT] Tactic: 61 Time: 0.124002
[11/24/2022-12:12:56] [V] [TRT] Tactic: 112 Time: 0.048797
[11/24/2022-12:12:56] [V] [TRT] Tactic: 113 Time: 0.0533547
[11/24/2022-12:12:56] [V] [TRT] Tactic: 114 Time: 0.104457
[11/24/2022-12:12:56] [V] [TRT] Tactic: 116 Time: 1.4266
[11/24/2022-12:12:56] [V] [TRT] Tactic: 117 Time: 0.126761
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: 56 Time: 0.0469337
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:12:56] [V] [TRT] Tactic: 621442388677115936 Time: 0.0166573
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 697756878388249475
[11/24/2022-12:12:56] [V] [TRT] Tactic: 697756878388249475 Time: 0.0100968
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 1159272950022995759
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1159272950022995759 Time: 0.0152741
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0120069
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 2290218393647758202
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2290218393647758202 Time: 0.0136515
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 2310520233542099555
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2310520233542099555 Time: 0.02616
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3377996665278764661 Time: 0.0342299
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0176442
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0232464
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4918658762935651592 Time: 0.0245234
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5779835512569528575 Time: 0.0262667
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0316809
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6166883504066133838
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6166883504066133838 Time: 0.0227886
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0235611
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6500866402607985231
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6500866402607985231 Time: 0.0189731
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6723161876874263939
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6723161876874263939 Time: 0.0206374
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6868013466259746979
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6868013466259746979 Time: 0.0150798
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 6901214267543238617
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6901214267543238617 Time: 0.012531
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8048119769507926928 Time: 0.0238705
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:12:56] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0204741
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -8877086111929938764
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8877086111929938764 Time: 0.0288951
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8766093103475083267 Time: 0.012917
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8198656951359619379
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8198656951359619379 Time: 0.0203777
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0236114
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7145578994937510651
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7145578994937510651 Time: 0.019136
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -7070045993088702524
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7070045993088702524 Time: 0.0320183
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: -6622064180404051845
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6622064180404051845 Time: 0.0201217
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0258667
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6273689210331812572 Time: 0.0263512
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4562045946847239058 Time: 0.02042
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0213349
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2777237991111865351 Time: 0.0265097
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0209149
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1349585930542925704 Time: 0.0131965
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1123676555321336786 Time: 0.0268343
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:12:56] [V] [TRT] Tactic: -701551393537224327 Time: 0.0233365
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3258434593395023
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3258434593395023 Time: 0.0485272
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: 697756878388249475 Time: 0.0100968
[11/24/2022-12:12:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 697756878388249475
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Float(88704,1,4032,96) -> Float(22176,1,1008,24) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1162498931361159915 Time: 0.0179509
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1663866669559596164 Time: 0.0260884
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0183634
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0180097
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0150395
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0150117
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0181686
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5778138195697110003 Time: 0.025936
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0126377
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8918020581761223752 Time: 0.0255314
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -8031737312007363273
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8031737312007363273 Time: 0.0125581
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0177808
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4896615592193611463
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4896615592193611463 Time: 0.0288229
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -4056705536979434560
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4056705536979434560 Time: 0.0177057
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0148023
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: -3071763921328736248
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3071763921328736248 Time: 0.0177803
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2809379259463049391 Time: 0.0259787
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1985235291706575900 Time: 0.0250179
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:12:56] [V] [TRT] Tactic: -504296718212024303 Time: 0.0238224
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: -8031737312007363273 Time: 0.0125581
[11/24/2022-12:12:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8031737312007363273
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,1008,24) -> Float(5544,1:4,252,6) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0128267
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0126781
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 3119404851233737725
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3119404851233737725 Time: 0.00987977
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5108195418077987197
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5108195418077987197 Time: 0.00992488
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5380043773350002416
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5380043773350002416 Time: 0.0109688
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 5610788582700027969
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5610788582700027969 Time: 0.0124103
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0126293
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6419443404913215692
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6419443404913215692 Time: 0.0177006
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 6571171993204510025
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6571171993204510025 Time: 0.0175091
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0101056
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0120324
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -8853476220903838035
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8853476220903838035 Time: 0.00923743
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -7067026478815706014
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7067026478815706014 Time: 0.0126427
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0097987
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6073218138311523634 Time: 0.017665
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5033173285090644307
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5033173285090644307 Time: 0.00994408
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: -5010594849215755610
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5010594849215755610 Time: 0.0124735
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0177768
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0095811
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1138876066247138089 Time: 0.010398
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: -8853476220903838035 Time: 0.00923743
[11/24/2022-12:12:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8853476220903838035
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(88704,924,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudnnConvolution)
[11/24/2022-12:12:56] [V] [TRT] Tactic: 0 Time: 0.0479787
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1 Time: 0.0567406
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2 Time: 0.0681966
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4 Time: 1.45216
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5 Time: 0.122537
[11/24/2022-12:12:56] [V] [TRT] Tactic: 56 Time: 0.0511147
[11/24/2022-12:12:56] [V] [TRT] Tactic: 58 Time: 0.0688686
[11/24/2022-12:12:56] [V] [TRT] Tactic: 60 Time: 1.42877
[11/24/2022-12:12:56] [V] [TRT] Tactic: 61 Time: 0.120517
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: 0 Time: 0.0479787
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(22176,924,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(44352,924:2,42,1) -> Half(11088,924:2,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (FusedConvActConvolution)
[11/24/2022-12:12:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Float(22176,924,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,504,12) -> Half(2772,1:8,126,3) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudaDepthwiseConvolution)
[11/24/2022-12:12:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:12:56] [V] [TRT] Tactic: 254850674756030979 Time: 0.0149883
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0146683
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0116923
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0125253
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0121806
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1576319725282257846 Time: 0.00980998
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1832046141070096030 Time: 0.00976457
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1838082074606840426 Time: 0.00998339
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 1877373136269439559
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1877373136269439559 Time: 0.0111905
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1899296423087490472 Time: 0.00943657
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2238656696610018305 Time: 0.00980937
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0117303
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0123726
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2657157263811141609 Time: 0.00944457
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2968605903460894194 Time: 0.00996815
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3071479995783211391 Time: 0.00791314
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3359475309458902373 Time: 0.00952657
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0116427
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0150834
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0123307
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 3899310434460415852
[11/24/2022-12:12:56] [V] [TRT] Tactic: 3899310434460415852 Time: 0.0078975
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4278315135102886928 Time: 0.00944914
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4370476717970497892
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4370476717970497892 Time: 0.00930257
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4480294673430783793 Time: 0.00923
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4491683531415781597
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4491683531415781597 Time: 0.0122537
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4528997467275241200
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4528997467275241200 Time: 0.00954088
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0122564
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0151557
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4595173549602041350
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4595173549602041350 Time: 0.0122149
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0121581
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 4993757826442493905
[11/24/2022-12:12:56] [V] [TRT] Tactic: 4993757826442493905 Time: 0.00886911
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0147886
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0149691
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0103752
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0115172
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:12:56] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0126099
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6034364043891107501 Time: 0.009162
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0149445
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0118618
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0106253
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 6697277555581639516
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6697277555581639516 Time: 0.00873869
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0117521
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:12:56] [V] [TRT] Tactic: 6859477213531075460 Time: 0.00921914
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0123269
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:12:56] [V] [TRT] Tactic: 7609923741161019135 Time: 0.00963474
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0118506
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8101703987960976805 Time: 0.00955764
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0101726
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0123695
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 8823554289762712606
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8823554289762712606 Time: 0.00926686
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:12:56] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0119882
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -9203179519031456182
[11/24/2022-12:12:56] [V] [TRT] Tactic: -9203179519031456182 Time: 0.00743589
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:12:56] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0123177
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8604374562669615024 Time: 0.00942057
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0138045
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0122754
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:12:56] [V] [TRT] Tactic: -8131857373260504832 Time: 0.00938171
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7410012245391920273 Time: 0.00940229
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7099920365135295801 Time: 0.00889734
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:12:56] [V] [TRT] Tactic: -7089118800560870395 Time: 0.00903429
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -6768327495007644783
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6768327495007644783 Time: 0.00969508
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6356316196810535311 Time: 0.00965669
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:12:56] [V] [TRT] Tactic: -6063766379489217211 Time: 0.00988069
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0117577
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5409588854490562130 Time: 0.00743109
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0120945
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5161596964442251102 Time: 0.00986819
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5127240325355316006 Time: 0.00937914
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:12:56] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0150679
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4950923835688973492 Time: 0.00872121
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0100428
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4548822885169694805 Time: 0.009436
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4379519430184503304 Time: 0.00965821
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4293222705763522367 Time: 0.00888336
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0149413
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:12:56] [V] [TRT] Tactic: -4021926646879732549 Time: 0.00965211
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0101964
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0128324
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0120072
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0121981
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3601464762214218301 Time: 0.00909429
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3234716536615144018
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3234716536615144018 Time: 0.011123
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -3200815656917281917
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3200815656917281917 Time: 0.0146368
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:12:56] [V] [TRT] Tactic: -3058330359340425555 Time: 0.00991055
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2878731503146438856 Time: 0.00978316
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2602982885923184927 Time: 0.010814
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2353603993968373338 Time: 0.012283
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2032577876140256150 Time: 0.00988191
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:12:56] [V] [TRT] Tactic: -2003055242756584050 Time: 0.00929371
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0122998
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -1828674067637788567
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1828674067637788567 Time: 0.00727657
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1640527254204634147 Time: 0.00974903
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1562548049711204899 Time: 0.00981425
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1242202084391243207 Time: 0.00941457
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1099247066487349374 Time: 0.00921771
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:12:56] [V] [TRT] Tactic: -1038291877007553549 Time: 0.00958689
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:12:56] [V] [TRT] Tactic: -406984317033388136 Time: 0.0123192
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:12:56] [V] [TRT] Tactic: -331499326992534460 Time: 0.00947114
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: -206523504474952360
[11/24/2022-12:12:56] [V] [TRT] Tactic: -206523504474952360 Time: 0.0102217
[11/24/2022-12:12:56] [V] [TRT] Fastest Tactic: -1828674067637788567 Time: 0.00727657
[11/24/2022-12:12:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1828674067637788567
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(5544,1:16,252,6) -> Half(1848,1:16,84,2) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Half(2772,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CublasConvolution)
[11/24/2022-12:12:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudaDepthwiseConvolution)
[11/24/2022-12:12:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:56] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:12:56] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0178245
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:12:56] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0177422
[11/24/2022-12:12:56] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0178594
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0149874
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0149239
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0149317
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0151378
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0147296
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:12:57] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0151086
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0151465
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:12:57] [V] [TRT] Tactic: -108011214168778087 Time: 0.0150473
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:12:57] [V] [TRT] Tactic: -42427192380281294 Time: 0.0147991
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: -4443833619060044580 Time: 0.0147296
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4443833619060044580
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(5544,924:4,42,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudaDepthwiseConvolution)
[11/24/2022-12:12:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (FusedConvActConvolution)
[11/24/2022-12:12:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:12:57] [V] [TRT] Tactic: 175853789719975416 Time: 0.0124343
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2171150287007712632 Time: 0.0122286
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2234457234705232274 Time: 0.0119615
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5834048089706882838 Time: 0.0121208
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 6299962968199310600
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6299962968199310600 Time: 0.0150546
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: 6341572697076960911
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6341572697076960911 Time: 0.0121691
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8626990807754934295 Time: 0.0120872
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -8498217049614706532
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8498217049614706532 Time: 0.0120446
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7303593854972602201 Time: 0.0120602
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6585664687867083638 Time: 0.0150341
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -3326139578711341011
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3326139578711341011 Time: 0.012221
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:12:57] [V] [TRT] Tactic: -683636008127039856 Time: 0.0151941
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 2234457234705232274 Time: 0.0119615
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2234457234705232274
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(22176,924:4,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1100922622480907544 Time: 0.0120423
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_interior_c32_nn_v1 Tactic: 2855900226702061782
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2855900226702061782 Time: 0.0147986
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3606311198834416176 Time: 0.0120815
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:12:57] [V] [TRT] Tactic: 4325765560739862899 Time: 0.0148069
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_interior_c32_nn_v1 Tactic: 8803458114157674373
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8803458114157674373 Time: 0.0118688
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6934773036503365000 Time: 0.0120522
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_interior_c32_nn_v1 Tactic: -4431642509665791294
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4431642509665791294 Time: 0.0118906
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4255737803793506479 Time: 0.0149842
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3958182351168863467 Time: 0.0119669
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3111968753064955248 Time: 0.0121272
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1492575840277333548 Time: 0.012259
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:12:57] [V] [TRT] Tactic: -868495160148524802 Time: 0.0119615
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 8803458114157674373 Time: 0.0118688
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8803458114157674373
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(22176,924,42,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3426497547019031858 Time: 0.00911743
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0115967
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5287526117701381005 Time: 0.00899
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: -5287526117701381005 Time: 0.00899
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5287526117701381005
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Float(924,924:32,42,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2185926646498217601
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2185926646498217601 Time: 0.00964389
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2818014835119698671 Time: 0.00757365
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3721599319722771137 Time: 0.00750537
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:12:57] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0120453
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0143273
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0118523
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6618077155362058131 Time: 0.00753949
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0100059
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7348718297764976805
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7348718297764976805 Time: 0.0073344
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7869897696365535632
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7869897696365535632 Time: 0.0071003
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7970271430402365872
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7970271430402365872 Time: 0.00751291
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8584126525867982141
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8584126525867982141 Time: 0.00751928
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8912999970161746151 Time: 0.00756692
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0100721
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8069335661823714580
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8069335661823714580 Time: 0.0116111
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7988637803896331454 Time: 0.011885
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7957004747664952265
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7957004747664952265 Time: 0.0100023
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0129257
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7633993163187901093
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7633993163187901093 Time: 0.00695532
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0119832
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0140659
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -7007036200777870226
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7007036200777870226 Time: 0.00705263
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0070141
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0120998
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0119019
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4704615512436071369
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4704615512436071369 Time: 0.00873385
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0119326
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3644377136375731441 Time: 0.012093
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3502495740607894730 Time: 0.00738217
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:12:57] [V] [TRT] Tactic: -2342404147487779225 Time: 0.008962
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0120987
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:12:57] [V] [TRT] Tactic: -621838502160440068 Time: 0.0121596
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: -7633993163187901093 Time: 0.00695532
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7633993163187901093
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Half(924,924:32,42,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:12:57] [V] [TRT] Tactic: 424230345342282109 Time: 0.0121318
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2088124366723311762
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2088124366723311762 Time: 0.00904686
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0119103
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2881044142075831475 Time: 0.00736023
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:12:57] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0148768
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5730376045873629665 Time: 0.00746606
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0115397
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0118657
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7507411019787288861 Time: 0.00918543
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0150135
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7563002870293617494 Time: 0.00747429
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 7796695344726998947
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7796695344726998947 Time: 0.00748274
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8142426754608472547 Time: 0.00915714
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8440932616520880415
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8440932616520880415 Time: 0.00712751
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8471142395703548718
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8471142395703548718 Time: 0.00728046
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 9072692108481390634
[11/24/2022-12:12:57] [V] [TRT] Tactic: 9072692108481390634 Time: 0.00709899
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8897233019398469012
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8897233019398469012 Time: 0.00887502
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8732118422363495199 Time: 0.00720686
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8206171403568243244
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8206171403568243244 Time: 0.00694552
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0120964
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0120415
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6183300053070809929
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6183300053070809929 Time: 0.0101336
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6079719874915919252
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6079719874915919252 Time: 0.00991817
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0119745
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5528442507917877226 Time: 0.00716366
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3773982102975252832 Time: 0.00756716
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0119592
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3514726588976755320 Time: 0.01032
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:12:57] [V] [TRT] Tactic: -2649556861007671996 Time: 0.00690264
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0137716
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1008204680238783384 Time: 0.011878
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:12:57] [V] [TRT] Tactic: -50323486981480818 Time: 0.011976
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: -2649556861007671996 Time: 0.00690264
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2649556861007671996
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(2772,924:32,42,1) -> Int8(924,924:32,42,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudaGroupConvolution)
[11/24/2022-12:12:57] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CudaDepthwiseConvolution)
[11/24/2022-12:12:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (FusedConvActConvolution)
[11/24/2022-12:12:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_713 + node_of_714 + node_of_715 (CaskConvolution)
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 125145153013230687
[11/24/2022-12:12:57] [V] [TRT] Tactic: 125145153013230687 Time: 0.00961341
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1583811548148740665
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1583811548148740665 Time: 0.00857815
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 1701344857577810806
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1701344857577810806 Time: 0.00844558
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 1797231177354918208
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1797231177354918208 Time: 0.00737691
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 2756291002030759362
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2756291002030759362 Time: 0.00769059
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3043273137345374664
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3043273137345374664 Time: 0.00761961
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 3538565962642681625
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3538565962642681625 Time: 0.00766147
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 3593397928177382100
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3593397928177382100 Time: 0.00757269
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4112572034735311841
[11/24/2022-12:12:57] [V] [TRT] Tactic: 4112572034735311841 Time: 0.00731246
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4610760414797216079
[11/24/2022-12:12:57] [V] [TRT] Tactic: 4610760414797216079 Time: 0.00768361
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:12:57] [V] [TRT] Tactic: 4796956614760326119 Time: 0.00774689
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5204702486885981735 Time: 0.00739726
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5443897483205284103
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5443897483205284103 Time: 0.00756042
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5707566217891294846
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5707566217891294846 Time: 0.00895972
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5986622376339202983
[11/24/2022-12:12:57] [V] [TRT] Tactic: 5986622376339202983 Time: 0.00895139
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6007888770437705057
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6007888770437705057 Time: 0.00964541
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6405251167055673379
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6405251167055673379 Time: 0.00878413
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6433368103202497147
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6433368103202497147 Time: 0.00946143
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6441948709525127755
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6441948709525127755 Time: 0.00739771
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6443933097134654777
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6443933097134654777 Time: 0.00952943
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6457435868048963632 Time: 0.00745028
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6793988781414507278 Time: 0.00899171
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6925201228918187099
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6925201228918187099 Time: 0.00911829
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6991524515605108718
[11/24/2022-12:12:57] [V] [TRT] Tactic: 6991524515605108718 Time: 0.00913029
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7318929579222925725
[11/24/2022-12:12:57] [V] [TRT] Tactic: 7318929579222925725 Time: 0.00886239
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8142283985160822229
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8142283985160822229 Time: 0.010041
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8173975624668590862
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8173975624668590862 Time: 0.0100413
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8234775147403903473
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8234775147403903473 Time: 0.0117553
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 8524082966802584889
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8524082966802584889 Time: 0.00738057
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8765382722978397630
[11/24/2022-12:12:57] [V] [TRT] Tactic: 8765382722978397630 Time: 0.00830933
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:12:57] [V] [TRT] Tactic: -8638624340850784688 Time: 0.00727063
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -7844028314176826857
[11/24/2022-12:12:57] [V] [TRT] Tactic: -7844028314176826857 Time: 0.00754791
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6879607992933502380
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6879607992933502380 Time: 0.00787176
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6510232214299595844 Time: 0.00702999
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -6232597026469067819
[11/24/2022-12:12:57] [V] [TRT] Tactic: -6232597026469067819 Time: 0.00934029
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5671123121710113970
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5671123121710113970 Time: 0.00753155
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5562968047117507056 Time: 0.009388
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5516472881360101487 Time: 0.00753444
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4455415102719506646 Time: 0.00705154
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -4425346730823666456
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4425346730823666456 Time: 0.011815
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -4182501876984672402
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4182501876984672402 Time: 0.00864323
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -4151617293257698859
[11/24/2022-12:12:57] [V] [TRT] Tactic: -4151617293257698859 Time: 0.00965181
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3825889760337461729 Time: 0.00710683
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -3613322253849278738
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3613322253849278738 Time: 0.00722697
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3288585994448820820
[11/24/2022-12:12:57] [V] [TRT] Tactic: -3288585994448820820 Time: 0.0094
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2754311112012636251
[11/24/2022-12:12:57] [V] [TRT] Tactic: -2754311112012636251 Time: 0.00853997
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:12:57] [V] [TRT] Tactic: -2432868635536396215 Time: 0.00782484
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -2315453944962430928
[11/24/2022-12:12:57] [V] [TRT] Tactic: -2315453944962430928 Time: 0.0105962
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1916483171117495388 Time: 0.00918657
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -1549742793039499659
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1549742793039499659 Time: 0.009664
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -1328736756812546664
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1328736756812546664 Time: 0.00916343
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:12:57] [V] [TRT] Tactic: -1006589727652607355 Time: 0.00683167
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -405554772060757402
[11/24/2022-12:12:57] [V] [TRT] Tactic: -405554772060757402 Time: 0.00726583
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -375949437730908730
[11/24/2022-12:12:57] [V] [TRT] Tactic: -375949437730908730 Time: 0.00733143
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -111878368089469751
[11/24/2022-12:12:57] [V] [TRT] Tactic: -111878368089469751 Time: 0.0107938
[11/24/2022-12:12:57] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:12:57] [V] [TRT] Tactic: -19707840769375107 Time: 0.00749554
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: -1006589727652607355 Time: 0.00683167
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1006589727652607355
[11/24/2022-12:12:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(22176,924,42,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] Tactic: 0 Time: 0.0339749
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1 Time: 0.0338222
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3 Time: 2.5104
[11/24/2022-12:12:57] [V] [TRT] Tactic: 24 Time: 0.234336
[11/24/2022-12:12:57] [V] [TRT] Tactic: 25 Time: 0.262523
[11/24/2022-12:12:57] [V] [TRT] Tactic: 27 Time: 3.17704
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 1 Time: 0.0338222
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] Tactic: 0 Time: 0.364818
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 0 Time: 0.364818
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] node_of_716 Set Tactic Name: sm50_xmma_deconv_generic_f32f32_f32_f32_nchwkcrs_nchw Tactic: 1108745107350470483
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 1108745107350470483 Time: 10000
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(22176,1,1008,24) -> Float(88704,1,2016,24) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] node_of_716 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 1461874880923808087
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1461874880923808087 Time: 0.61936
[11/24/2022-12:12:57] [V] [TRT] node_of_716 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x128x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2647374945310797548
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2647374945310797548 Time: 1.5011
[11/24/2022-12:12:57] [V] [TRT] node_of_716 Set Tactic Name: sm80_xmma_deconv_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -5631711556980973584
[11/24/2022-12:12:57] [V] [TRT] Tactic: -5631711556980973584 Time: 1.61104
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 1461874880923808087 Time: 0.61936
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskDeconvolutionV2 Tactic: 1461874880923808087
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(5544,1:4,252,6) -> Float(22176,1:4,504,6) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(22176,924,42,1) -> Half(88704,3696,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] Tactic: 0 Time: 0.0361909
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1 Time: 0.036104
[11/24/2022-12:12:57] [V] [TRT] Tactic: 3 Time: 2.6054
[11/24/2022-12:12:57] [V] [TRT] Tactic: 24 Time: 0.295319
[11/24/2022-12:12:57] [V] [TRT] Tactic: 27 Time: 3.2132
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 1 Time: 0.036104
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] Tactic: 0 Time: 0.350126
[11/24/2022-12:12:57] [V] [TRT] Fastest Tactic: 0 Time: 0.350126
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnDeconvolution Tactic: 1
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(11088,924:2,42,1) -> Half(44352,3696:2,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(2772,1:8,126,3) -> Half(11088,1:8,252,3) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(1848,1:16,84,2) -> Half(7392,1:16,168,2) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(924,924:32,42,1) -> Half(3696,3696:32,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(5544,924:4,42,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(5544,924:4,42,1) -> Int8(22176,3696:4,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Float(88704,3696,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Float(3696,3696:32,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(924,924:32,42,1) -> Int8(3696,3696:32,84,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CudnnDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CudnnDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (GemmDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] GemmDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolution)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_716 (CaskDeconvolutionV2)
[11/24/2022-12:12:57] [V] [TRT] CaskDeconvolutionV2 has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(88704,3696,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(88704,1,2016,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(22176,1:4,504,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(88704,3696,84,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(44352,3696:2,84,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(11088,1:8,252,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(7392,1:16,168,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(3696,3696:32,84,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(22176,3696:4,84,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(3696,3696:32,84,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1), Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24), Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6), Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(14784,14784:32,168,1), Float(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(1:4,14784,168,1), Float(1:4,14784,168,1) -> Float(1:4,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1), Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1), Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3), Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2), Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1), Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(1:8,14784,168,1), Half(1:8,14784,168,1) -> Half(1:8,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(354816:32,14784,168,1), Half(354816:32,14784,168,1) -> Half(354816:32,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(354816,14784,168,1), Int8(354816,14784,168,1) -> Int8(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1), Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1), Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(354816:32,14784,168,1), Int8(354816:32,14784,168,1) -> Int8(354816:32,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(354816,1,4032,24) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(177408,14784:2,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(88704,14784:4,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(354816,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(14784,14784:32,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:12:57] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudaDepthwiseConvolution)
[11/24/2022-12:12:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (FusedConvActConvolution)
[11/24/2022-12:12:57] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:12:57] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudnnConvolution)
[11/24/2022-12:12:57] [V] [TRT] Tactic: 0 Time: 2.27294
[11/24/2022-12:12:57] [V] [TRT] Tactic: 1 Time: 1.41747
[11/24/2022-12:12:57] [V] [TRT] Tactic: 2 Time: 3.2041
[11/24/2022-12:13:05] [V] [TRT] Tactic: 4 Time: 748.328
[11/24/2022-12:13:06] [V] [TRT] Tactic: 5 Time: 8.7914
[11/24/2022-12:13:06] [V] [TRT] Tactic: 6 Time: 1.61911
[11/24/2022-12:13:06] [V] [TRT] Tactic: 56 Time: 2.02889
[11/24/2022-12:13:06] [V] [TRT] Tactic: 57 Time: 1.14692
[11/24/2022-12:13:06] [V] [TRT] Tactic: 58 Time: 2.71157
[11/24/2022-12:13:13] [V] [TRT] Tactic: 60 Time: 725.882
[11/24/2022-12:13:13] [V] [TRT] Tactic: 61 Time: 8.75129
[11/24/2022-12:13:13] [V] [TRT] Tactic: 62 Time: 1.60757
[11/24/2022-12:13:14] [V] [TRT] Tactic: 112 Time: 1.98923
[11/24/2022-12:13:14] [V] [TRT] Tactic: 113 Time: 2.10686
[11/24/2022-12:13:14] [V] [TRT] Tactic: 114 Time: 2.39509
[11/24/2022-12:13:21] [V] [TRT] Tactic: 116 Time: 744.652
[11/24/2022-12:13:21] [V] [TRT] Tactic: 117 Time: 8.7929
[11/24/2022-12:13:21] [V] [TRT] Tactic: 118 Time: 1.602
[11/24/2022-12:13:21] [V] [TRT] Fastest Tactic: 57 Time: 1.14692
[11/24/2022-12:13:21] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 130477820174479366
[11/24/2022-12:13:21] [V] [TRT] Tactic: 130477820174479366 Time: 1.32664
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 1358952225285826925
[11/24/2022-12:13:21] [V] [TRT] Tactic: 1358952225285826925 Time: 1.38908
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:21] [V] [TRT] Tactic: 4549827808004681195 Time: 1.17663
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5127140674766136213
[11/24/2022-12:13:21] [V] [TRT] Tactic: 5127140674766136213 Time: 1.45229
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 5691674214365884252
[11/24/2022-12:13:21] [V] [TRT] Tactic: 5691674214365884252 Time: 1.2804
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:21] [V] [TRT] Tactic: 5779835512569528575 Time: 1.06164
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 6053873026024413720
[11/24/2022-12:13:21] [V] [TRT] Tactic: 6053873026024413720 Time: 1.2525
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 6532229230713743445
[11/24/2022-12:13:21] [V] [TRT] Tactic: 6532229230713743445 Time: 1.32155
[11/24/2022-12:13:21] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 6767548733843469815
[11/24/2022-12:13:22] [V] [TRT] Tactic: 6767548733843469815 Time: 1.15795
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -7777264329408437990
[11/24/2022-12:13:22] [V] [TRT] Tactic: -7777264329408437990 Time: 0.84528
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -6693149634808211969
[11/24/2022-12:13:22] [V] [TRT] Tactic: -6693149634808211969 Time: 1.45706
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:22] [V] [TRT] Tactic: -6313876406580483184 Time: 1.28487
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: -4932505327461806800
[11/24/2022-12:13:22] [V] [TRT] Tactic: -4932505327461806800 Time: 1.31661
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: -2870780723387717246
[11/24/2022-12:13:22] [V] [TRT] Tactic: -2870780723387717246 Time: 1.96087
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:22] [V] [TRT] Tactic: -1123676555321336786 Time: 1.07472
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:22] [V] [TRT] Tactic: -701551393537224327 Time: 1.19817
[11/24/2022-12:13:22] [V] [TRT] Fastest Tactic: -7777264329408437990 Time: 0.84528
[11/24/2022-12:13:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7777264329408437990
[11/24/2022-12:13:22] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:13:22] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 1852818056038333088
[11/24/2022-12:13:22] [V] [TRT] Tactic: 1852818056038333088 Time: 1.30264
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 2137271960938803767
[11/24/2022-12:13:22] [V] [TRT] Tactic: 2137271960938803767 Time: 1.07213
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:13:22] [V] [TRT] Tactic: 2860655430572478466 Time: 1.55077
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:13:22] [V] [TRT] Tactic: 4474630279712975759 Time: 1.73836
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:13:22] [V] [TRT] Tactic: 4479823862704990365 Time: 1.73101
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 4543151729465212056
[11/24/2022-12:13:22] [V] [TRT] Tactic: 4543151729465212056 Time: 1.24974
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:13:22] [V] [TRT] Tactic: 4696204239951173149 Time: 1.56364
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:13:22] [V] [TRT] Tactic: 5778138195697110003 Time: 1.03842
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 7098622778606028509
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7098622778606028509 Time: 1.15985
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 7155825427510256858
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7155825427510256858 Time: 1.02238
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:13:22] [V] [TRT] Tactic: 8918020581761223752 Time: 1.01306
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: -9217704540809507511
[11/24/2022-12:13:22] [V] [TRT] Tactic: -9217704540809507511 Time: 1.12442
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -7734972403155710907
[11/24/2022-12:13:22] [V] [TRT] Tactic: -7734972403155710907 Time: 1.13021
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: -4756382386362004279
[11/24/2022-12:13:22] [V] [TRT] Tactic: -4756382386362004279 Time: 1.54654
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: -3855385237722507464
[11/24/2022-12:13:22] [V] [TRT] Tactic: -3855385237722507464 Time: 1.05728
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -3360299822783115645
[11/24/2022-12:13:22] [V] [TRT] Tactic: -3360299822783115645 Time: 1.05062
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:13:22] [V] [TRT] Tactic: -2809379259463049391 Time: 1.05212
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: -824800713406371346
[11/24/2022-12:13:22] [V] [TRT] Tactic: -824800713406371346 Time: 1.06769
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:13:22] [V] [TRT] Tactic: -504296718212024303 Time: 1.01361
[11/24/2022-12:13:22] [V] [TRT] Fastest Tactic: 8918020581761223752 Time: 1.01306
[11/24/2022-12:13:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8918020581761223752
[11/24/2022-12:13:22] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:13:22] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 1237784342446422381
[11/24/2022-12:13:22] [V] [TRT] Tactic: 1237784342446422381 Time: 0.613701
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 1426562292875733922
[11/24/2022-12:13:22] [V] [TRT] Tactic: 1426562292875733922 Time: 0.644992
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 2388153022056233219
[11/24/2022-12:13:22] [V] [TRT] Tactic: 2388153022056233219 Time: 0.381463
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 2716437853123234317
[11/24/2022-12:13:22] [V] [TRT] Tactic: 2716437853123234317 Time: 0.425303
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 3278852197192504305
[11/24/2022-12:13:22] [V] [TRT] Tactic: 3278852197192504305 Time: 1.17374
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: 3904690393614050557
[11/24/2022-12:13:22] [V] [TRT] Tactic: 3904690393614050557 Time: 0.436736
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 4061115162338989075
[11/24/2022-12:13:22] [V] [TRT] Tactic: 4061115162338989075 Time: 1.30302
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: 5200329514761435342
[11/24/2022-12:13:22] [V] [TRT] Tactic: 5200329514761435342 Time: 0.380983
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 7011693366046809027
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7011693366046809027 Time: 0.371328
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7342025736444949634
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7342025736444949634 Time: 0.405806
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7347365539922924600
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7347365539922924600 Time: 0.581339
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7428197830878119671
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7428197830878119671 Time: 0.612325
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 7465323447915168822
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7465323447915168822 Time: 1.87591
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: 7938223790021272801
[11/24/2022-12:13:22] [V] [TRT] Tactic: 7938223790021272801 Time: 1.98606
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 8836645772682419994
[11/24/2022-12:13:22] [V] [TRT] Tactic: 8836645772682419994 Time: 0.591287
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -9114138070928278731
[11/24/2022-12:13:22] [V] [TRT] Tactic: -9114138070928278731 Time: 1.26458
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8 Tactic: -7382359095196034537
[11/24/2022-12:13:22] [V] [TRT] Tactic: -7382359095196034537 Time: 0.38427
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -7377458734869418330
[11/24/2022-12:13:22] [V] [TRT] Tactic: -7377458734869418330 Time: 0.371122
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -6223854811627385844
[11/24/2022-12:13:22] [V] [TRT] Tactic: -6223854811627385844 Time: 0.485134
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5457304872213719461
[11/24/2022-12:13:22] [V] [TRT] Tactic: -5457304872213719461 Time: 0.3824
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: -5441054706931585554
[11/24/2022-12:13:22] [V] [TRT] Tactic: -5441054706931585554 Time: 0.972503
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: -5043603702497465467
[11/24/2022-12:13:22] [V] [TRT] Tactic: -5043603702497465467 Time: 0.510272
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8 Tactic: -4564655677311401797
[11/24/2022-12:13:22] [V] [TRT] Tactic: -4564655677311401797 Time: 0.949979
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: -3540975627865078064
[11/24/2022-12:13:22] [V] [TRT] Tactic: -3540975627865078064 Time: 0.500571
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -3151804561246216835
[11/24/2022-12:13:22] [V] [TRT] Tactic: -3151804561246216835 Time: 0.549669
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8 Tactic: -2885165284206163001
[11/24/2022-12:13:22] [V] [TRT] Tactic: -2885165284206163001 Time: 2.16396
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -2801041895330778813
[11/24/2022-12:13:22] [V] [TRT] Tactic: -2801041895330778813 Time: 0.412302
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8 Tactic: -1758690179295738332
[11/24/2022-12:13:22] [V] [TRT] Tactic: -1758690179295738332 Time: 0.402226
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: -1484546572846226796
[11/24/2022-12:13:22] [V] [TRT] Tactic: -1484546572846226796 Time: 0.916677
[11/24/2022-12:13:22] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: -858667497925695276
[11/24/2022-12:13:22] [V] [TRT] Tactic: -858667497925695276 Time: 0.566263
[11/24/2022-12:13:22] [V] [TRT] Fastest Tactic: -7377458734869418330 Time: 0.371122
[11/24/2022-12:13:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7377458734869418330
[11/24/2022-12:13:22] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:13:22] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudnnConvolution)
[11/24/2022-12:13:23] [V] [TRT] Tactic: 0 Time: 1.99254
[11/24/2022-12:13:23] [V] [TRT] Tactic: 1 Time: 1.8036
[11/24/2022-12:13:23] [V] [TRT] Tactic: 2 Time: 19.2014
[11/24/2022-12:13:30] [V] [TRT] Tactic: 4 Time: 725.493
[11/24/2022-12:13:31] [V] [TRT] Tactic: 5 Time: 8.71413
[11/24/2022-12:13:31] [V] [TRT] Tactic: 6 Time: 1.92123
[11/24/2022-12:13:31] [V] [TRT] Tactic: 56 Time: 1.98145
[11/24/2022-12:13:31] [V] [TRT] Tactic: 58 Time: 19.2315
[11/24/2022-12:13:38] [V] [TRT] Tactic: 60 Time: 744.879
[11/24/2022-12:13:39] [V] [TRT] Tactic: 61 Time: 8.71706
[11/24/2022-12:13:39] [V] [TRT] Tactic: 62 Time: 1.92747
[11/24/2022-12:13:39] [V] [TRT] Fastest Tactic: 1 Time: 1.8036
[11/24/2022-12:13:39] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:13:39] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:13:39] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (FusedConvActConvolution)
[11/24/2022-12:13:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:39] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2195670545862694453 Time: 0.758542
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 3419182076704469245
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3419182076704469245 Time: 0.727781
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3891805945559659536 Time: 0.83653
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5548126322150286555 Time: 0.723753
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6057304366605292508 Time: 0.718446
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -7928611605886347652
[11/24/2022-12:13:39] [V] [TRT] Tactic: -7928611605886347652 Time: 0.857184
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: -5172391392092686714
[11/24/2022-12:13:39] [V] [TRT] Tactic: -5172391392092686714 Time: 0.764722
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:39] [V] [TRT] Tactic: -4374269919094467161 Time: 0.749422
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: -4083394051665370953
[11/24/2022-12:13:39] [V] [TRT] Tactic: -4083394051665370953 Time: 0.61712
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:39] [V] [TRT] Tactic: -1546027692247304867 Time: 0.84224
[11/24/2022-12:13:39] [V] [TRT] Fastest Tactic: -4083394051665370953 Time: 0.61712
[11/24/2022-12:13:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4083394051665370953
[11/24/2022-12:13:39] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:39] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:39] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:39] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:13:39] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudaDepthwiseConvolution)
[11/24/2022-12:13:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:39] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:39] [V] [TRT] Tactic: 254850674756030979 Time: 0.362665
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 328038211831149625
[11/24/2022-12:13:39] [V] [TRT] Tactic: 328038211831149625 Time: 0.247749
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 411553864378931917
[11/24/2022-12:13:39] [V] [TRT] Tactic: 411553864378931917 Time: 0.382551
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 605415215044822950
[11/24/2022-12:13:39] [V] [TRT] Tactic: 605415215044822950 Time: 0.194903
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 1011057357468998345
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1011057357468998345 Time: 0.264325
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1016009564074305832 Time: 0.355666
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1156328698016730421 Time: 0.409339
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 1723736032573714698
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1723736032573714698 Time: 0.376005
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1832046141070096030 Time: 0.542999
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1838082074606840426 Time: 0.369605
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:39] [V] [TRT] Tactic: 1899296423087490472 Time: 0.612466
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 2428167804343994714
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2428167804343994714 Time: 0.408695
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2541579301352125276 Time: 0.312178
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 2618052373734885647
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2618052373734885647 Time: 0.182665
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2657157263811141609 Time: 0.764494
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 2754576449974188611
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2754576449974188611 Time: 0.354985
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 2819719497590964443
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2819719497590964443 Time: 0.545317
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2968605903460894194 Time: 0.372119
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 2986078304285316765
[11/24/2022-12:13:39] [V] [TRT] Tactic: 2986078304285316765 Time: 0.315145
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16 Tactic: 3016308193087082166
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3016308193087082166 Time: 0.390674
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 3221382575080507859
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3221382575080507859 Time: 0.408955
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3362537467505018070 Time: 0.387867
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3513075359009385578 Time: 0.42752
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 3524252352629695977
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3524252352629695977 Time: 0.461989
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: 3573559043797674382
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3573559043797674382 Time: 0.554907
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 3591970081995419777
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3591970081995419777 Time: 0.503342
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:39] [V] [TRT] Tactic: 3704534001553878387 Time: 0.39237
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:39] [V] [TRT] Tactic: 4278315135102886928 Time: 0.489097
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 4503233883285355107
[11/24/2022-12:13:39] [V] [TRT] Tactic: 4503233883285355107 Time: 0.651968
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:39] [V] [TRT] Tactic: 4540505769798915372 Time: 0.407717
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:39] [V] [TRT] Tactic: 4802447371470387646 Time: 0.451959
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5059676457552313631 Time: 0.360059
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 5368829646735632944
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5368829646735632944 Time: 0.523447
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5398999388616959893 Time: 0.504183
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 5746691132547383910
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5746691132547383910 Time: 0.414853
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 5770170567977052602
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5770170567977052602 Time: 0.373536
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 5953552212833506549
[11/24/2022-12:13:39] [V] [TRT] Tactic: 5953552212833506549 Time: 0.318601
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6034364043891107501 Time: 0.460955
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: 6074229447555668232
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6074229447555668232 Time: 0.627735
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6154447660803990543
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6154447660803990543 Time: 0.384567
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6325769668000961702
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6325769668000961702 Time: 0.380197
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 6350273239113254096
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6350273239113254096 Time: 0.885198
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6377497238381488891 Time: 0.381783
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: 6446388116965632819
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6446388116965632819 Time: 0.405591
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6468794451065529747 Time: 0.547598
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6509152032538119080
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6509152032538119080 Time: 0.344078
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 6642277870194067185
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6642277870194067185 Time: 0.432599
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16 Tactic: 6703181542003057635
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6703181542003057635 Time: 0.386843
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6859477213531075460 Time: 0.628274
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 6972489290272968208
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6972489290272968208 Time: 0.260078
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 6979044990896381511
[11/24/2022-12:13:39] [V] [TRT] Tactic: 6979044990896381511 Time: 0.253243
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:39] [V] [TRT] Tactic: 7216571380637776659 Time: 0.290729
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:39] [V] [TRT] Tactic: 7609923741161019135 Time: 0.424347
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: 7705739241028240201
[11/24/2022-12:13:39] [V] [TRT] Tactic: 7705739241028240201 Time: 0.802021
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 8072087735545283117
[11/24/2022-12:13:39] [V] [TRT] Tactic: 8072087735545283117 Time: 0.246976
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:39] [V] [TRT] Tactic: 8101703987960976805 Time: 0.615689
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:39] [V] [TRT] Tactic: 8170606396342855895 Time: 0.530912
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:39] [V] [TRT] Tactic: 8839784824303350101 Time: 0.27211
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_large_nhwc_tn_v1 Tactic: -9217371357561775773
[11/24/2022-12:13:39] [V] [TRT] Tactic: -9217371357561775773 Time: 0.615511
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:39] [V] [TRT] Tactic: -9009272790678027912 Time: 0.49664
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -8985224497679592364
[11/24/2022-12:13:39] [V] [TRT] Tactic: -8985224497679592364 Time: 0.650126
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -8949544755481315679
[11/24/2022-12:13:39] [V] [TRT] Tactic: -8949544755481315679 Time: 0.371973
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -8867999442759527766
[11/24/2022-12:13:39] [V] [TRT] Tactic: -8867999442759527766 Time: 0.415991
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: -8759929675070720385
[11/24/2022-12:13:39] [V] [TRT] Tactic: -8759929675070720385 Time: 0.369262
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:39] [V] [TRT] Tactic: -8604374562669615024 Time: 0.782729
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -8362347876645295759
[11/24/2022-12:13:39] [V] [TRT] Tactic: -8362347876645295759 Time: 0.340078
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -7757610000269494813
[11/24/2022-12:13:39] [V] [TRT] Tactic: -7757610000269494813 Time: 0.357669
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6917689122519989488
[11/24/2022-12:13:39] [V] [TRT] Tactic: -6917689122519989488 Time: 0.418336
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -6902925267326201166
[11/24/2022-12:13:39] [V] [TRT] Tactic: -6902925267326201166 Time: 0.827218
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -6840588038605932325
[11/24/2022-12:13:39] [V] [TRT] Tactic: -6840588038605932325 Time: 0.503625
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: -6799856376604253964
[11/24/2022-12:13:39] [V] [TRT] Tactic: -6799856376604253964 Time: 0.239269
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: -6625722781282978136
[11/24/2022-12:13:39] [V] [TRT] Tactic: -6625722781282978136 Time: 0.564023
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6525498856028268801
[11/24/2022-12:13:39] [V] [TRT] Tactic: -6525498856028268801 Time: 0.319328
[11/24/2022-12:13:39] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6356316196810535311 Time: 0.820517
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -6324345858751792783
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6324345858751792783 Time: 0.56896
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -6262400699544994312
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6262400699544994312 Time: 0.240352
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -6257787336162086472
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6257787336162086472 Time: 0.407739
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6063766379489217211 Time: 0.529851
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -5777580938094193096
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5777580938094193096 Time: 0.375904
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: -5657273398217409378
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5657273398217409378 Time: 0.258487
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5530886555766748586 Time: 0.308873
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -5422685219138380548
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5422685219138380548 Time: 0.38976
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5261787675443473128 Time: 0.403127
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5161596964442251102 Time: 0.412882
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5127240325355316006 Time: 0.46053
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5109582882231362997 Time: 0.357897
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -4825567853927730435
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4825567853927730435 Time: 0.388571
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4796511246675321840 Time: 0.525344
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_large_nhwc_tn_v1 Tactic: -4706569565442112734
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4706569565442112734 Time: 0.835781
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -4566599693570369588
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4566599693570369588 Time: 0.373061
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -4409144516525410768
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4409144516525410768 Time: 0.388192
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4379519430184503304 Time: 0.401275
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4152066959007262150 Time: 0.406213
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4021926646879732549 Time: 0.49819
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3987638434926559037 Time: 0.522441
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3905653247016903130 Time: 0.544626
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -3903974568488493144
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3903974568488493144 Time: 0.391831
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_large_nhwc_tn_v1 Tactic: -3895429239811098010
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3895429239811098010 Time: 0.461509
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3864869056275745423 Time: 0.35536
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3601464762214218301 Time: 0.627282
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -3412636942650049698
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3412636942650049698 Time: 0.547109
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -3338665856053412950
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3338665856053412950 Time: 0.321961
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: -3243541398692466074
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3243541398692466074 Time: 0.351241
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3058330359340425555 Time: 0.405422
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r3s3 Tactic: -2899647483672319239
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2899647483672319239 Time: 0.383799
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2816084650627734155
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2816084650627734155 Time: 0.504119
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2662892962457732243
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2662892962457732243 Time: 0.38235
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2559894581585337900
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2559894581585337900 Time: 0.365303
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -2530740716768816092
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2530740716768816092 Time: 0.56325
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2332828394978346992
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2332828394978346992 Time: 0.261531
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: -2241736083352441442
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2241736083352441442 Time: 0.28896
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: -2161909437867201546
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2161909437867201546 Time: 0.858501
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:40] [V] [TRT] Tactic: -1985778916402815946 Time: 0.367954
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: -1502788097503482299
[11/24/2022-12:13:40] [V] [TRT] Tactic: -1502788097503482299 Time: 0.423305
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_large_nhwc_tn_v1 Tactic: -1500496213132463076
[11/24/2022-12:13:40] [V] [TRT] Tactic: -1500496213132463076 Time: 0.565861
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:40] [V] [TRT] Tactic: -1099247066487349374 Time: 0.739963
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: -910286698936744682
[11/24/2022-12:13:40] [V] [TRT] Tactic: -910286698936744682 Time: 0.534981
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: -606726295133751039
[11/24/2022-12:13:40] [V] [TRT] Tactic: -606726295133751039 Time: 0.653541
[11/24/2022-12:13:40] [V] [TRT] Fastest Tactic: 2618052373734885647 Time: 0.182665
[11/24/2022-12:13:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2618052373734885647
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudaDepthwiseConvolution)
[11/24/2022-12:13:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: 1332468635798226953
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1332468635798226953 Time: 0.611451
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1508480131241957639 Time: 0.390194
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: 1947019689364377201
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1947019689364377201 Time: 0.425737
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:40] [V] [TRT] Tactic: 3239257003214966313 Time: 0.389957
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:40] [V] [TRT] Tactic: 5592640619112287921 Time: 0.40752
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:40] [V] [TRT] Tactic: 7621465827583909090 Time: 0.390537
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5576936487443445631 Time: 0.396128
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2297737319934264721 Time: 0.422405
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:40] [V] [TRT] Tactic: -1425085658556684465 Time: 0.435259
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:40] [V] [TRT] Tactic: -108011214168778087 Time: 0.409701
[11/24/2022-12:13:40] [V] [TRT] Fastest Tactic: 3239257003214966313 Time: 0.389957
[11/24/2022-12:13:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3239257003214966313
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudaDepthwiseConvolution)
[11/24/2022-12:13:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (FusedConvActConvolution)
[11/24/2022-12:13:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 175853789719975416
[11/24/2022-12:13:40] [V] [TRT] Tactic: 175853789719975416 Time: 0.392987
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: 2171150287007712632
[11/24/2022-12:13:40] [V] [TRT] Tactic: 2171150287007712632 Time: 0.388201
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 2234457234705232274
[11/24/2022-12:13:40] [V] [TRT] Tactic: 2234457234705232274 Time: 0.368649
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 5834048089706882838
[11/24/2022-12:13:40] [V] [TRT] Tactic: 5834048089706882838 Time: 0.369467
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:13:40] [V] [TRT] Tactic: -8626990807754934295 Time: 0.387483
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: -7303593854972602201
[11/24/2022-12:13:40] [V] [TRT] Tactic: -7303593854972602201 Time: 0.36992
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6585664687867083638
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6585664687867083638 Time: 0.3584
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_xregs_large_nn_v1 Tactic: -3730012925709297561
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3730012925709297561 Time: 0.365655
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_xregs_large_nn_v1 Tactic: -2277259417488004546
[11/24/2022-12:13:40] [V] [TRT] Tactic: -2277259417488004546 Time: 0.481408
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -683636008127039856
[11/24/2022-12:13:40] [V] [TRT] Tactic: -683636008127039856 Time: 0.359246
[11/24/2022-12:13:40] [V] [TRT] Fastest Tactic: -6585664687867083638 Time: 0.3584
[11/24/2022-12:13:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6585664687867083638
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_xregs_large_c32_nn_v1 Tactic: 984309058095623735
[11/24/2022-12:13:40] [V] [TRT] Tactic: 984309058095623735 Time: 0.363954
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1100922622480907544 Time: 0.384987
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_xregs_large_c32_nn_v1 Tactic: 3238312825609165543
[11/24/2022-12:13:40] [V] [TRT] Tactic: 3238312825609165543 Time: 0.481673
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_medium_c32_nn_v1 Tactic: 3606311198834416176
[11/24/2022-12:13:40] [V] [TRT] Tactic: 3606311198834416176 Time: 0.368471
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_small_c32_nn_v1 Tactic: 4325765560739862899
[11/24/2022-12:13:40] [V] [TRT] Tactic: 4325765560739862899 Time: 0.360448
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x128_relu_medium_c32_nn_v1 Tactic: -4255737803793506479
[11/24/2022-12:13:40] [V] [TRT] Tactic: -4255737803793506479 Time: 0.36
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_small_c32_nn_v1 Tactic: -3958182351168863467
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3958182351168863467 Time: 0.367634
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_xregs_medium_c32_nn_v1 Tactic: -3111968753064955248
[11/24/2022-12:13:40] [V] [TRT] Tactic: -3111968753064955248 Time: 0.384823
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_medium_c32_nn_v1 Tactic: -1492575840277333548
[11/24/2022-12:13:40] [V] [TRT] Tactic: -1492575840277333548 Time: 0.39024
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x64_relu_small_c32_nn_v1 Tactic: -868495160148524802
[11/24/2022-12:13:40] [V] [TRT] Tactic: -868495160148524802 Time: 0.365838
[11/24/2022-12:13:40] [V] [TRT] Fastest Tactic: -4255737803793506479 Time: 0.36
[11/24/2022-12:13:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4255737803793506479
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4_nchw Tactic: 1083238733416584316
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1083238733416584316 Time: 0.323246
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3_alignc4_nchw Tactic: 7376107914735551821
[11/24/2022-12:13:40] [V] [TRT] Tactic: 7376107914735551821 Time: 0.307749
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3_alignc4_nchw Tactic: -49960371584465908
[11/24/2022-12:13:40] [V] [TRT] Tactic: -49960371584465908 Time: 0.380407
[11/24/2022-12:13:40] [V] [TRT] Fastest Tactic: 7376107914735551821 Time: 0.307749
[11/24/2022-12:13:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7376107914735551821
[11/24/2022-12:13:40] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:13:40] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 1011019097971850911
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1011019097971850911 Time: 0.263438
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 1071114551801767124
[11/24/2022-12:13:40] [V] [TRT] Tactic: 1071114551801767124 Time: 0.252078
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 2623576043214044314
[11/24/2022-12:13:40] [V] [TRT] Tactic: 2623576043214044314 Time: 0.322551
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 3281631721811475881
[11/24/2022-12:13:40] [V] [TRT] Tactic: 3281631721811475881 Time: 0.262816
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 4551754795416974366
[11/24/2022-12:13:40] [V] [TRT] Tactic: 4551754795416974366 Time: 0.329582
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: 4925112190271421402
[11/24/2022-12:13:40] [V] [TRT] Tactic: 4925112190271421402 Time: 0.397778
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:40] [V] [TRT] Tactic: 5012796702462679112 Time: 0.339186
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 5041593333398049019
[11/24/2022-12:13:40] [V] [TRT] Tactic: 5041593333398049019 Time: 0.298857
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 5166018662410176512
[11/24/2022-12:13:40] [V] [TRT] Tactic: 5166018662410176512 Time: 0.300965
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 6191867932654611882
[11/24/2022-12:13:40] [V] [TRT] Tactic: 6191867932654611882 Time: 0.249495
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:40] [V] [TRT] Tactic: 6556170942941957134 Time: 0.240613
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 6852868042694587230
[11/24/2022-12:13:40] [V] [TRT] Tactic: 6852868042694587230 Time: 0.288599
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 7603959388016355182
[11/24/2022-12:13:40] [V] [TRT] Tactic: 7603959388016355182 Time: 0.310592
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 8399092794516815300
[11/24/2022-12:13:40] [V] [TRT] Tactic: 8399092794516815300 Time: 0.296896
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -9132922677633967263
[11/24/2022-12:13:40] [V] [TRT] Tactic: -9132922677633967263 Time: 0.260672
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:40] [V] [TRT] Tactic: -7988637803896331454 Time: 0.233339
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 Tactic: -7865001268126363229
[11/24/2022-12:13:40] [V] [TRT] Tactic: -7865001268126363229 Time: 0.245257
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:40] [V] [TRT] Tactic: -7606074703023778034 Time: 0.230889
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: -7413564913826321357
[11/24/2022-12:13:40] [V] [TRT] Tactic: -7413564913826321357 Time: 0.267552
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:40] [V] [TRT] Tactic: -7282232519526877434 Time: 0.328571
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: -6705478269695173396
[11/24/2022-12:13:40] [V] [TRT] Tactic: -6705478269695173396 Time: 0.429243
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -5942379529065248478
[11/24/2022-12:13:40] [V] [TRT] Tactic: -5942379529065248478 Time: 0.259813
[11/24/2022-12:13:40] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5603587790314027122 Time: 0.237262
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: -5334776871777565833
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5334776871777565833 Time: 0.305317
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: -5157868397078537095
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5157868397078537095 Time: 0.256023
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -5100834417027499764
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5100834417027499764 Time: 0.296626
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -3365360067423513506
[11/24/2022-12:13:41] [V] [TRT] Tactic: -3365360067423513506 Time: 0.368617
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -2585288983596291193
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2585288983596291193 Time: 0.335451
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 Tactic: -2194148180068068313
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2194148180068068313 Time: 0.341157
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -1782593837177056527
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1782593837177056527 Time: 0.263648
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1610768292520086910 Time: 0.244576
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: -1573035963956198975
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1573035963956198975 Time: 0.292731
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 Tactic: -1558762241666006941
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1558762241666006941 Time: 0.244539
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 Tactic: -1365353082499976145
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1365353082499976145 Time: 0.239488
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:41] [V] [TRT] Tactic: -621838502160440068 Time: 0.248805
[11/24/2022-12:13:41] [V] [TRT] Fastest Tactic: -7606074703023778034 Time: 0.230889
[11/24/2022-12:13:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7606074703023778034
[11/24/2022-12:13:41] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:41] [V] [TRT] Tactic: 424230345342282109 Time: 0.198107
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_large_nt_v1 Tactic: 1382943425417484710
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1382943425417484710 Time: 0.25003
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_large_nt_v1 Tactic: 1793500908545723874
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1793500908545723874 Time: 0.204731
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:41] [V] [TRT] Tactic: 2327398338581585326 Time: 0.199246
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 2760006678121069075
[11/24/2022-12:13:41] [V] [TRT] Tactic: 2760006678121069075 Time: 0.143822
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 4167221735570463707
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4167221735570463707 Time: 0.273856
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4472476544237636929
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4472476544237636929 Time: 0.181403
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4549109251242445288 Time: 0.247237
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 4698357802839444845
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4698357802839444845 Time: 0.183808
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4891894697406912893
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4891894697406912893 Time: 0.130645
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 5020064464968349253
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5020064464968349253 Time: 0.145344
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: 5656242925971916403
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5656242925971916403 Time: 0.165723
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 5884259471515203209
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5884259471515203209 Time: 0.354213
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 6346362250001597649
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6346362250001597649 Time: 0.197001
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7178538052023824067 Time: 0.193061
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7515859573761964679 Time: 0.244869
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_large_nt_v1 Tactic: -8539208697831798967
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8539208697831798967 Time: 0.196704
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: -8140396860606875456
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8140396860606875456 Time: 0.151771
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:41] [V] [TRT] Tactic: -7272221766465547628 Time: 0.192946
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:41] [V] [TRT] Tactic: -6733478368603461850 Time: 0.190327
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -5986750462116019981
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5986750462116019981 Time: 0.343854
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -5951380861215432834
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5951380861215432834 Time: 0.211406
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -5212619216958109577
[11/24/2022-12:13:41] [V] [TRT] Tactic: -5212619216958109577 Time: 0.234469
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -4245321710353452500
[11/24/2022-12:13:41] [V] [TRT] Tactic: -4245321710353452500 Time: 0.267826
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -3685182686910560333
[11/24/2022-12:13:41] [V] [TRT] Tactic: -3685182686910560333 Time: 0.297074
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -2911474341550239945
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2911474341550239945 Time: 0.304256
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_large_nt_v1 Tactic: -2274492545683590731
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2274492545683590731 Time: 0.202075
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -2132775718427811685
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2132775718427811685 Time: 0.166761
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -2108711254262400304
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2108711254262400304 Time: 0.136201
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1715646389905866876
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1715646389905866876 Time: 0.15648
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1008204680238783384 Time: 0.183351
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -401874538028639698
[11/24/2022-12:13:41] [V] [TRT] Tactic: -401874538028639698 Time: 0.122158
[11/24/2022-12:13:41] [V] [TRT] Fastest Tactic: -401874538028639698 Time: 0.122158
[11/24/2022-12:13:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -401874538028639698
[11/24/2022-12:13:41] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudaGroupConvolution)
[11/24/2022-12:13:41] [V] [TRT] CudaGroupConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CudaDepthwiseConvolution)
[11/24/2022-12:13:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (FusedConvActConvolution)
[11/24/2022-12:13:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 (CaskConvolution)
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 184229963126259101
[11/24/2022-12:13:41] [V] [TRT] Tactic: 184229963126259101 Time: 0.18213
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32 Tactic: 328135613486708155
[11/24/2022-12:13:41] [V] [TRT] Tactic: 328135613486708155 Time: 0.251291
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32 Tactic: 1111159740952609683
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1111159740952609683 Time: 0.165554
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: 1134860903395928905
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1134860903395928905 Time: 0.19029
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: 1276591930377039442
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1276591930377039442 Time: 0.197925
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32 Tactic: 1399501420456320585
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1399501420456320585 Time: 0.247867
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x96x64_stage5_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 1853122447892949466
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1853122447892949466 Time: 0.226734
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: 2325023763229477890
[11/24/2022-12:13:41] [V] [TRT] Tactic: 2325023763229477890 Time: 0.139611
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32 Tactic: 2783960536172159663
[11/24/2022-12:13:41] [V] [TRT] Tactic: 2783960536172159663 Time: 0.152631
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32 Tactic: 2821711838552913693
[11/24/2022-12:13:41] [V] [TRT] Tactic: 2821711838552913693 Time: 0.141493
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 3401614690060226673
[11/24/2022-12:13:41] [V] [TRT] Tactic: 3401614690060226673 Time: 0.267218
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32 Tactic: 3456719996792527006
[11/24/2022-12:13:41] [V] [TRT] Tactic: 3456719996792527006 Time: 0.156594
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4042202769383439184
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4042202769383439184 Time: 0.178107
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32 Tactic: 4734519122557206480
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4734519122557206480 Time: 0.141621
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: 4922297020351187339
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4922297020351187339 Time: 0.155465
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 5136656982162849059
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5136656982162849059 Time: 0.347616
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 5189825015507701541
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5189825015507701541 Time: 0.243867
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32 Tactic: 5424417905073460656
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5424417905073460656 Time: 0.22667
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32 Tactic: 5442043907221427810
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5442043907221427810 Time: 0.152553
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x256x64_stage3_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 5544365258913999384
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5544365258913999384 Time: 0.148846
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 5721595115357140131
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5721595115357140131 Time: 0.132363
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: 6004789655466615912
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6004789655466615912 Time: 0.201678
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 6146901278630392829
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6146901278630392829 Time: 0.134921
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: 6781129591847482048
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6781129591847482048 Time: 0.192969
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 6984451771200230840
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6984451771200230840 Time: 0.20885
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32 Tactic: 7077570591813340966
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7077570591813340966 Time: 0.157088
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32_t1r3s3 Tactic: 7429976449747682901
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7429976449747682901 Time: 0.147182
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 8096257414008860171
[11/24/2022-12:13:41] [V] [TRT] Tactic: 8096257414008860171 Time: 0.176759
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: 8128112048355596715
[11/24/2022-12:13:41] [V] [TRT] Tactic: 8128112048355596715 Time: 0.144713
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_indexed_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: 9064458886956700976
[11/24/2022-12:13:41] [V] [TRT] Tactic: 9064458886956700976 Time: 0.132183
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: -9165697322068360861
[11/24/2022-12:13:41] [V] [TRT] Tactic: -9165697322068360861 Time: 0.149417
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8691377209893505057
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8691377209893505057 Time: 0.133545
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8520292213102999339
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8520292213102999339 Time: 0.140706
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x192x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -8417388128970254446
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8417388128970254446 Time: 0.155131
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8263994888336646547
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8263994888336646547 Time: 0.129291
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -8205948405243401049
[11/24/2022-12:13:41] [V] [TRT] Tactic: -8205948405243401049 Time: 0.289518
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -7898477046581738867
[11/24/2022-12:13:41] [V] [TRT] Tactic: -7898477046581738867 Time: 0.217861
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -7683887278997527517
[11/24/2022-12:13:41] [V] [TRT] Tactic: -7683887278997527517 Time: 0.290825
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32 Tactic: -7381370635708568663
[11/24/2022-12:13:41] [V] [TRT] Tactic: -7381370635708568663 Time: 0.162126
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -7129320389887881029
[11/24/2022-12:13:41] [V] [TRT] Tactic: -7129320389887881029 Time: 0.175758
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -6959995514028471820
[11/24/2022-12:13:41] [V] [TRT] Tactic: -6959995514028471820 Time: 0.145545
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x96x64_stage4_warpsize4x2x1_g1_tensor16x8x32 Tactic: -6256128573036943404
[11/24/2022-12:13:41] [V] [TRT] Tactic: -6256128573036943404 Time: 0.219867
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -4933563390723451692
[11/24/2022-12:13:41] [V] [TRT] Tactic: -4933563390723451692 Time: 0.204453
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -3280888557222886418
[11/24/2022-12:13:41] [V] [TRT] Tactic: -3280888557222886418 Time: 0.14341
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -3238475748440751107
[11/24/2022-12:13:41] [V] [TRT] Tactic: -3238475748440751107 Time: 0.162299
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -3182884991006484042
[11/24/2022-12:13:41] [V] [TRT] Tactic: -3182884991006484042 Time: 0.132699
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -3173468756112541306
[11/24/2022-12:13:41] [V] [TRT] Tactic: -3173468756112541306 Time: 0.265038
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -2741641298163591508
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2741641298163591508 Time: 0.152923
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize48x128x64_stage3_warpsize1x4x1_g1_tensor16x8x32 Tactic: -2054375205435666404
[11/24/2022-12:13:41] [V] [TRT] Tactic: -2054375205435666404 Time: 0.158103
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1546787387293556842
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1546787387293556842 Time: 0.116779
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32 Tactic: -1498626619443284096
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1498626619443284096 Time: 0.215685
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1471245223605064669
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1471245223605064669 Time: 0.131479
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32 Tactic: -1283580231568512025
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1283580231568512025 Time: 0.346926
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x64x64_stage3_warpsize4x1x1_g1_tensor16x8x32_t1r3s3 Tactic: -1224421172675151280
[11/24/2022-12:13:41] [V] [TRT] Tactic: -1224421172675151280 Time: 0.140089
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x128x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -921247911551089037
[11/24/2022-12:13:41] [V] [TRT] Tactic: -921247911551089037 Time: 0.125998
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32 Tactic: -762222380308749469
[11/24/2022-12:13:41] [V] [TRT] Tactic: -762222380308749469 Time: 0.231785
[11/24/2022-12:13:41] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -516725800067794372
[11/24/2022-12:13:41] [V] [TRT] Tactic: -516725800067794372 Time: 0.145998
[11/24/2022-12:13:41] [V] [TRT] Fastest Tactic: -1546787387293556842 Time: 0.116779
[11/24/2022-12:13:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1546787387293556842
[11/24/2022-12:13:41] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:41] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_724 (CudaDepthwiseConvolution)
[11/24/2022-12:13:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:41] [V] [TRT] --------------- Timing Runner: node_of_724 (FusedConvActConvolution)
[11/24/2022-12:13:41] [V] [TRT] Tactic: 589823 Time: 0.0993874
[11/24/2022-12:13:41] [V] [TRT] Tactic: 786431 Time: 0.0561387
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1179647 Time: 0.106878
[11/24/2022-12:13:41] [V] [TRT] Tactic: 1638399 Time: 0.0668084
[11/24/2022-12:13:41] [V] [TRT] Tactic: 2097151 Time: 0.0762766
[11/24/2022-12:13:41] [V] [TRT] Tactic: 3538943 Time: 0.0896069
[11/24/2022-12:13:41] [V] [TRT] Tactic: 3997695 Time: 0.0622004
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4194303 Time: 0.050112
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4259839 Time: 0.0681646
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4587519 Time: 0.0530728
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4653055 Time: 0.116791
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4915199 Time: 0.0650697
[11/24/2022-12:13:41] [V] [TRT] Tactic: 4980735 Time: 0.0528366
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5177343 Time: 0.111915
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5242879 Time: 0.0792366
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5373951 Time: 0.12363
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5767167 Time: 0.187328
[11/24/2022-12:13:41] [V] [TRT] Tactic: 5898239 Time: 0.106261
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6225919 Time: 0.0785806
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6291455 Time: 0.106487
[11/24/2022-12:13:41] [V] [TRT] Tactic: 6815743 Time: 0.0891657
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7012351 Time: 0.0783771
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7077887 Time: 0.0890674
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7143423 Time: 0.110466
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7208959 Time: 0.0779543
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7340031 Time: 0.112389
[11/24/2022-12:13:41] [V] [TRT] Tactic: 7536639 Time: 0.212635
[11/24/2022-12:13:42] [V] [TRT] Tactic: 7733247 Time: 0.105369
[11/24/2022-12:13:42] [V] [TRT] Tactic: 8191999 Time: 0.0743337
[11/24/2022-12:13:42] [V] [TRT] Tactic: 8716287 Time: 0.122254
[11/24/2022-12:13:42] [V] [TRT] Tactic: 9109503 Time: 0.0870971
[11/24/2022-12:13:42] [V] [TRT] Tactic: 9568255 Time: 0.074496
[11/24/2022-12:13:42] [V] [TRT] Tactic: 10354687 Time: 0.0701151
[11/24/2022-12:13:42] [V] [TRT] Tactic: 10747903 Time: 0.102777
[11/24/2022-12:13:42] [V] [TRT] Fastest Tactic: 4194303 Time: 0.050112
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CudnnConvolution)
[11/24/2022-12:13:42] [V] [TRT] Tactic: 0 Time: 0.050333
[11/24/2022-12:13:42] [V] [TRT] Tactic: 1 Time: 0.0527848
[11/24/2022-12:13:42] [V] [TRT] Tactic: 2 Time: 0.0706423
[11/24/2022-12:13:42] [V] [TRT] Tactic: 4 Time: 3.73408
[11/24/2022-12:13:42] [V] [TRT] Tactic: 5 Time: 0.256142
[11/24/2022-12:13:42] [V] [TRT] Tactic: 56 Time: 0.0542232
[11/24/2022-12:13:42] [V] [TRT] Tactic: 57 Time: 0.0508617
[11/24/2022-12:13:42] [V] [TRT] Tactic: 58 Time: 0.101957
[11/24/2022-12:13:42] [V] [TRT] Tactic: 60 Time: 3.69856
[11/24/2022-12:13:42] [V] [TRT] Tactic: 61 Time: 0.223968
[11/24/2022-12:13:42] [V] [TRT] Tactic: 112 Time: 0.0493105
[11/24/2022-12:13:42] [V] [TRT] Tactic: 113 Time: 0.0514316
[11/24/2022-12:13:42] [V] [TRT] Tactic: 114 Time: 0.0831017
[11/24/2022-12:13:42] [V] [TRT] Tactic: 116 Time: 2.82769
[11/24/2022-12:13:42] [V] [TRT] Tactic: 117 Time: 0.221847
[11/24/2022-12:13:42] [V] [TRT] Fastest Tactic: 112 Time: 0.0493105
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:42] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:13:42] [V] [TRT] Tactic: 621442388677115936 Time: 0.153051
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:13:42] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0799314
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:13:42] [V] [TRT] Tactic: 3377996665278764661 Time: 0.292887
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:13:42] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0862331
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:42] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0666225
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:13:42] [V] [TRT] Tactic: 4918658762935651592 Time: 0.136725
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:42] [V] [TRT] Tactic: 5779835512569528575 Time: 0.116635
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:13:42] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0991109
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:13:42] [V] [TRT] Tactic: 6210049212073459059 Time: 0.069987
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:13:42] [V] [TRT] Tactic: 8048119769507926928 Time: 0.144987
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:13:42] [V] [TRT] Tactic: 9151672657204310840 Time: 0.088736
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:13:42] [V] [TRT] Tactic: -8766093103475083267 Time: 0.080624
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:13:42] [V] [TRT] Tactic: -7491730084094677098 Time: 0.040936
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:42] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0454137
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:13:42] [V] [TRT] Tactic: -6273689210331812572 Time: 0.115838
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:13:42] [V] [TRT] Tactic: -4562045946847239058 Time: 0.153614
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:13:42] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0639299
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:13:42] [V] [TRT] Tactic: -2777237991111865351 Time: 0.163918
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:13:42] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0887337
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:13:42] [V] [TRT] Tactic: -1349585930542925704 Time: 0.110377
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:42] [V] [TRT] Tactic: -1123676555321336786 Time: 0.119394
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:42] [V] [TRT] Tactic: -701551393537224327 Time: 0.0696229
[11/24/2022-12:13:42] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.040936
[11/24/2022-12:13:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:13:42] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(635712,1,7224,43) ***************
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:42] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:13:42] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122085
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:13:42] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0778994
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:13:42] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0725714
[11/24/2022-12:13:42] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0725714
[11/24/2022-12:13:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:13:42] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:42] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:13:42] [V] [TRT] Tactic: 1373022415249282411 Time: 0.060291
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:13:42] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0575863
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:13:42] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0701211
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:13:42] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0822491
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:13:42] [V] [TRT] Tactic: 7058864664858220889 Time: 0.060317
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:13:42] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0685912
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:13:42] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0672716
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:13:42] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0936457
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:13:42] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0614872
[11/24/2022-12:13:42] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:13:42] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0572831
[11/24/2022-12:13:42] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0572831
[11/24/2022-12:13:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:13:42] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:42] [V] [TRT] --------------- Timing Runner: node_of_724 (CudnnConvolution)
[11/24/2022-12:13:42] [V] [TRT] Tactic: 0 Time: 0.0491459
[11/24/2022-12:13:42] [V] [TRT] Tactic: 1 Time: 0.0498423
[11/24/2022-12:13:42] [V] [TRT] Tactic: 2 Time: 0.0704838
[11/24/2022-12:13:42] [V] [TRT] Tactic: 4 Time: 3.57334
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5 Time: 0.212201
[11/24/2022-12:13:43] [V] [TRT] Tactic: 56 Time: 0.0492251
[11/24/2022-12:13:43] [V] [TRT] Tactic: 58 Time: 0.0706895
[11/24/2022-12:13:43] [V] [TRT] Tactic: 60 Time: 3.6865
[11/24/2022-12:13:43] [V] [TRT] Tactic: 61 Time: 0.173975
[11/24/2022-12:13:43] [V] [TRT] Fastest Tactic: 0 Time: 0.0491459
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (FusedConvActConvolution)
[11/24/2022-12:13:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0271977
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3891805945559659536 Time: 0.094528
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:13:43] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0421954
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0419109
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0406926
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:13:43] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0260084
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0709013
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0260785
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0951063
[11/24/2022-12:13:43] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0260084
[11/24/2022-12:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CudaDepthwiseConvolution)
[11/24/2022-12:13:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:43] [V] [TRT] Tactic: 254850674756030979 Time: 0.0336375
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0379874
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0282042
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0343717
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0204408
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0766491
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0421543
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0283246
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1899296423087490472 Time: 0.044728
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0477608
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0305033
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0550126
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0687451
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2968605903460894194 Time: 0.030091
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0223282
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0163916
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0484587
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0384114
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0336155
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:43] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0634712
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:13:43] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0222713
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:43] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0295589
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:13:43] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0353746
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:43] [V] [TRT] Tactic: 4802447371470387646 Time: 0.030859
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0339858
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0343735
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0283566
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0404869
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0310053
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0398423
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0336192
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0498164
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6468794451065529747 Time: 0.04732
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0719177
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:43] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0399646
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:43] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0220408
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:43] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0262903
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:13:43] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0276632
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:43] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0444743
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:43] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0442331
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:13:43] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0314258
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:43] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0213146
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:43] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0310427
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:43] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0638918
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:13:43] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0339959
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:13:43] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0316105
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:13:43] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0227252
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:13:43] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0650042
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:13:43] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0316206
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:13:43] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0554453
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:43] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0730949
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:43] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0401131
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5530886555766748586 Time: 0.029845
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0155214
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0303003
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0481006
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0407406
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0358994
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0265722
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0793189
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0424743
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0279878
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4293222705763522367 Time: 0.038472
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0375177
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0660602
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:43] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0813074
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:43] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0317605
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:13:43] [V] [TRT] Tactic: -3903342530518878192 Time: 0.020482
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:43] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0208385
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:43] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0396389
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:43] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0484069
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:13:43] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0192303
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:13:43] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0447931
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:13:43] [V] [TRT] Tactic: -2353603993968373338 Time: 0.029877
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:13:43] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0428149
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:13:43] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0383303
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0219095
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0275223
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1562548049711204899 Time: 0.028205
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0605958
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0567451
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0365794
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:13:43] [V] [TRT] Tactic: -406984317033388136 Time: 0.0329243
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:13:43] [V] [TRT] Tactic: -331499326992534460 Time: 0.0260137
[11/24/2022-12:13:43] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0155214
[11/24/2022-12:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(44352,1:16,504,3) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CublasConvolution)
[11/24/2022-12:13:43] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CudaDepthwiseConvolution)
[11/24/2022-12:13:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:43] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0612526
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:13:43] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0612312
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0617798
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0260038
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:43] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342583
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:13:43] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208647
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0341915
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:13:43] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0254674
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:43] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0208777
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:43] [V] [TRT] Tactic: -1425085658556684465 Time: 0.026067
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:43] [V] [TRT] Tactic: -108011214168778087 Time: 0.020674
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:13:43] [V] [TRT] Tactic: -42427192380281294 Time: 0.0339749
[11/24/2022-12:13:43] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.020674
[11/24/2022-12:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:43] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:13:43] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0157006
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:13:43] [V] [TRT] Tactic: 5104832031493112835 Time: 0.016419
[11/24/2022-12:13:43] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:13:43] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0178489
[11/24/2022-12:13:43] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0157006
[11/24/2022-12:13:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:13:43] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(29568,14784:32,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:13:44] [V] [TRT] Tactic: 2818014835119698671 Time: 0.018632
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:13:44] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0201291
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0244815
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0377646
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:44] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0305938
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:13:44] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0193743
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:13:44] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0399246
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:13:44] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0261455
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:13:44] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0257112
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:44] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0292498
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:13:44] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0320585
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:44] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0240731
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:44] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0323328
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:13:44] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0197451
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:44] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0239368
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:13:44] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0297518
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:13:44] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0305774
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:13:44] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0240846
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:13:44] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0239909
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:13:44] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0228996
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:44] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0236617
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:44] [V] [TRT] Tactic: -621838502160440068 Time: 0.0252579
[11/24/2022-12:13:44] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.018632
[11/24/2022-12:13:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] --------------- Timing Runner: node_of_724 (CaskConvolution)
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:44] [V] [TRT] Tactic: 424230345342282109 Time: 0.0206132
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:44] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0307639
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:13:44] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0180989
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0340837
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0231784
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0259276
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0304475
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0152901
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0341998
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0260541
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:13:44] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0232105
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:44] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0206008
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:44] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0206047
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:13:44] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0183806
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:13:44] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0150217
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:13:44] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0179057
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:13:44] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0293586
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:13:44] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0422583
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:13:44] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0153358
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:13:44] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0330843
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:44] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0205042
[11/24/2022-12:13:44] [V] [TRT] node_of_724 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:13:44] [V] [TRT] Tactic: -50323486981480818 Time: 0.0190297
[11/24/2022-12:13:44] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0150217
[11/24/2022-12:13:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:13:44] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(635712,1,7224,43) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(44352,1:16,504,3) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(29568,14784:32,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:44] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:13:44] [V] [TRT] --------------- Timing Runner: node_of_730 (CudaDepthwiseConvolution)
[11/24/2022-12:13:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:44] [V] [TRT] --------------- Timing Runner: node_of_730 (FusedConvActConvolution)
[11/24/2022-12:13:44] [V] [TRT] Tactic: 589823 Time: 0.218149
[11/24/2022-12:13:44] [V] [TRT] Tactic: 655359 Time: 0.205102
[11/24/2022-12:13:44] [V] [TRT] Tactic: 786431 Time: 0.090736
[11/24/2022-12:13:44] [V] [TRT] Tactic: 851967 Time: 0.261696
[11/24/2022-12:13:44] [V] [TRT] Tactic: 1179647 Time: 0.13709
[11/24/2022-12:13:44] [V] [TRT] Tactic: 1638399 Time: 0.100302
[11/24/2022-12:13:44] [V] [TRT] Tactic: 2097151 Time: 0.102411
[11/24/2022-12:13:44] [V] [TRT] Tactic: 3538943 Time: 0.127989
[11/24/2022-12:13:44] [V] [TRT] Tactic: 3932159 Time: 0.203314
[11/24/2022-12:13:44] [V] [TRT] Tactic: 3997695 Time: 0.0862766
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4194303 Time: 0.0898537
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4259839 Time: 0.096016
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4587519 Time: 0.0760709
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4653055 Time: 0.140576
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4915199 Time: 0.0895634
[11/24/2022-12:13:44] [V] [TRT] Tactic: 4980735 Time: 0.0969714
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5177343 Time: 0.137125
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5242879 Time: 0.120149
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5373951 Time: 0.1528
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5570559 Time: 0.216151
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5767167 Time: 0.237979
[11/24/2022-12:13:44] [V] [TRT] Tactic: 5898239 Time: 0.137607
[11/24/2022-12:13:44] [V] [TRT] Tactic: 6225919 Time: 0.113931
[11/24/2022-12:13:44] [V] [TRT] Tactic: 6291455 Time: 0.13733
[11/24/2022-12:13:44] [V] [TRT] Tactic: 6815743 Time: 0.129022
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7012351 Time: 0.103264
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7077887 Time: 0.109374
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7143423 Time: 0.170039
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7208959 Time: 0.12341
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7340031 Time: 0.144526
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7536639 Time: 0.267429
[11/24/2022-12:13:44] [V] [TRT] Tactic: 7733247 Time: 0.116999
[11/24/2022-12:13:44] [V] [TRT] Tactic: 8191999 Time: 0.104814
[11/24/2022-12:13:44] [V] [TRT] Tactic: 8716287 Time: 0.138537
[11/24/2022-12:13:44] [V] [TRT] Tactic: 9109503 Time: 0.105479
[11/24/2022-12:13:44] [V] [TRT] Tactic: 9568255 Time: 0.0900046
[11/24/2022-12:13:44] [V] [TRT] Tactic: 10354687 Time: 0.0861623
[11/24/2022-12:13:44] [V] [TRT] Tactic: 10747903 Time: 0.117433
[11/24/2022-12:13:44] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0760709
[11/24/2022-12:13:44] [V] [TRT] --------------- Timing Runner: node_of_730 (CudnnConvolution)
[11/24/2022-12:13:44] [V] [TRT] Tactic: 0 Time: 0.0672152
[11/24/2022-12:13:44] [V] [TRT] Tactic: 1 Time: 0.0676053
[11/24/2022-12:13:44] [V] [TRT] Tactic: 2 Time: 0.150235
[11/24/2022-12:13:45] [V] [TRT] Tactic: 4 Time: 20.1607
[11/24/2022-12:13:45] [V] [TRT] Tactic: 5 Time: 0.297682
[11/24/2022-12:13:45] [V] [TRT] Tactic: 56 Time: 0.0698133
[11/24/2022-12:13:45] [V] [TRT] Tactic: 57 Time: 0.0654674
[11/24/2022-12:13:45] [V] [TRT] Tactic: 58 Time: 0.150395
[11/24/2022-12:13:45] [V] [TRT] Tactic: 60 Time: 17.1132
[11/24/2022-12:13:45] [V] [TRT] Tactic: 61 Time: 0.246053
[11/24/2022-12:13:45] [V] [TRT] Tactic: 112 Time: 0.0618072
[11/24/2022-12:13:45] [V] [TRT] Tactic: 113 Time: 0.0784663
[11/24/2022-12:13:45] [V] [TRT] Tactic: 114 Time: 0.124624
[11/24/2022-12:13:45] [V] [TRT] Tactic: 116 Time: 15.6729
[11/24/2022-12:13:45] [V] [TRT] Tactic: 117 Time: 0.244037
[11/24/2022-12:13:45] [V] [TRT] Fastest Tactic: 112 Time: 0.0618072
[11/24/2022-12:13:45] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:45] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:45] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:45] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:13:45] [V] [TRT] Tactic: 621442388677115936 Time: 0.154624
[11/24/2022-12:13:45] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:13:45] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0841051
[11/24/2022-12:13:45] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:13:45] [V] [TRT] Tactic: 3377996665278764661 Time: 0.292933
[11/24/2022-12:13:45] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:13:45] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0920434
[11/24/2022-12:13:45] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:46] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0678019
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:13:46] [V] [TRT] Tactic: 4918658762935651592 Time: 0.143447
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:46] [V] [TRT] Tactic: 5779835512569528575 Time: 0.116946
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:13:46] [V] [TRT] Tactic: 5837905844602864231 Time: 0.110471
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:13:46] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0795268
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:13:46] [V] [TRT] Tactic: 8048119769507926928 Time: 0.15392
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:13:46] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0859017
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:13:46] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0802949
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:13:46] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0385497
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:46] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0432217
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:13:46] [V] [TRT] Tactic: -6273689210331812572 Time: 0.116528
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:13:46] [V] [TRT] Tactic: -4562045946847239058 Time: 0.153719
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:13:46] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0646476
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:13:46] [V] [TRT] Tactic: -2777237991111865351 Time: 0.161769
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0885486
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1349585930542925704 Time: 0.111733
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1123676555321336786 Time: 0.118855
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:46] [V] [TRT] Tactic: -701551393537224327 Time: 0.069117
[11/24/2022-12:13:46] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0385497
[11/24/2022-12:13:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:13:46] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:13:46] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:46] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:13:46] [V] [TRT] Tactic: 1162498931361159915 Time: 0.119232
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:13:46] [V] [TRT] Tactic: 1663866669559596164 Time: 0.104736
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:13:46] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0728137
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:13:46] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0701272
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:13:46] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0543695
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:13:46] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0546164
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:13:46] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0726103
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:13:46] [V] [TRT] Tactic: 5778138195697110003 Time: 0.105035
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:13:46] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0681737
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:13:46] [V] [TRT] Tactic: 8918020581761223752 Time: 0.103081
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:13:46] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0687314
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:13:46] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0527939
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:13:46] [V] [TRT] Tactic: -2809379259463049391 Time: 0.106622
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1985235291706575900 Time: 0.102366
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:13:46] [V] [TRT] Tactic: -504296718212024303 Time: 0.104379
[11/24/2022-12:13:46] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0527939
[11/24/2022-12:13:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:13:46] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:13:46] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:46] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:46] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:13:46] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0500236
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:13:46] [V] [TRT] Tactic: 2536540085349545921 Time: 0.046584
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:13:46] [V] [TRT] Tactic: 6031243482516294286 Time: 0.064896
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:13:46] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0756503
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:13:46] [V] [TRT] Tactic: 7058864664858220889 Time: 0.053824
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:13:46] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0639299
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:13:46] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0586514
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0884571
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0560792
[11/24/2022-12:13:46] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:13:46] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0514149
[11/24/2022-12:13:46] [V] [TRT] Fastest Tactic: 2536540085349545921 Time: 0.046584
[11/24/2022-12:13:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2536540085349545921
[11/24/2022-12:13:46] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:13:46] [V] [TRT] --------------- Timing Runner: node_of_730 (CudnnConvolution)
[11/24/2022-12:13:46] [V] [TRT] Tactic: 0 Time: 0.054208
[11/24/2022-12:13:46] [V] [TRT] Tactic: 1 Time: 0.0821806
[11/24/2022-12:13:46] [V] [TRT] Tactic: 2 Time: 0.165563
[11/24/2022-12:13:46] [V] [TRT] Tactic: 4 Time: 15.8262
[11/24/2022-12:13:46] [V] [TRT] Tactic: 5 Time: 0.224741
[11/24/2022-12:13:46] [V] [TRT] Tactic: 56 Time: 0.0540937
[11/24/2022-12:13:46] [V] [TRT] Tactic: 58 Time: 0.163026
[11/24/2022-12:13:47] [V] [TRT] Tactic: 60 Time: 15.4546
[11/24/2022-12:13:47] [V] [TRT] Tactic: 61 Time: 0.223227
[11/24/2022-12:13:47] [V] [TRT] Fastest Tactic: 56 Time: 0.0540937
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (FusedConvActConvolution)
[11/24/2022-12:13:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0267215
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3891805945559659536 Time: 0.094224
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0413966
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0413234
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0399874
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0245867
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0707368
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0263787
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0935931
[11/24/2022-12:13:47] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0245867
[11/24/2022-12:13:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CudaDepthwiseConvolution)
[11/24/2022-12:13:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:47] [V] [TRT] Tactic: 254850674756030979 Time: 0.0329125
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0348005
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0264038
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0328969
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1362727228442059924 Time: 0.019324
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0750697
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0403897
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0269181
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0435474
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0456789
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2541579301352125276 Time: 0.028896
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2559328254295148085 Time: 0.053731
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0667124
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0285646
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0205531
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0148128
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0476343
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0351278
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0330213
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0622476
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0203189
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0286912
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0332928
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0287241
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0329335
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0329097
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0274347
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0392983
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0292306
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0389623
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0330414
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0453463
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0453051
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0704747
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0393269
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0202629
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0257227
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:13:47] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0265821
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:47] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0438914
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:47] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0433897
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:13:47] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0288768
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:47] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0201709
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:47] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0287863
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:47] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0600945
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:13:47] [V] [TRT] Tactic: -8280443484414412687 Time: 0.032757
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:13:47] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0302546
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:13:47] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0216581
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0641981
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7099920365135295801 Time: 0.030709
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0538758
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:47] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0709166
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:47] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0390983
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0286848
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0138377
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5261787675443473128 Time: 0.028176
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0475703
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0395577
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0349641
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0253882
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0768617
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0411989
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0245455
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371463
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0348517
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0641661
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0794583
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3905653247016903130 Time: 0.03072
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0183583
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0201646
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0391246
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0465531
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0180463
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0440491
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0287058
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0417977
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0372171
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0203463
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0268335
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0268099
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0606918
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0564922
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0365989
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:13:47] [V] [TRT] Tactic: -406984317033388136 Time: 0.0309458
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:13:47] [V] [TRT] Tactic: -331499326992534460 Time: 0.0244952
[11/24/2022-12:13:47] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0138377
[11/24/2022-12:13:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CublasConvolution)
[11/24/2022-12:13:47] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CudaDepthwiseConvolution)
[11/24/2022-12:13:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:47] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0605836
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0605349
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0617326
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0244389
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0330533
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:13:47] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0201983
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0346825
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:13:47] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0245211
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2297737319934264721 Time: 0.020497
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0253539
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:47] [V] [TRT] Tactic: -108011214168778087 Time: 0.0204219
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:13:47] [V] [TRT] Tactic: -42427192380281294 Time: 0.0329591
[11/24/2022-12:13:47] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0201983
[11/24/2022-12:13:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0161371
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0163175
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0182411
[11/24/2022-12:13:47] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0161371
[11/24/2022-12:13:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0176325
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:13:47] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0184577
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0234149
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0317093
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0294665
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0176305
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:13:47] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0397291
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:13:47] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0253272
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:13:47] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0245638
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0288411
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0311561
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0226142
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0319963
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:13:47] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0188634
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0228095
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:13:47] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0287835
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0297079
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0232653
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:13:47] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0225992
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:13:47] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0222975
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:47] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0230028
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:47] [V] [TRT] Tactic: -621838502160440068 Time: 0.0241394
[11/24/2022-12:13:47] [V] [TRT] Fastest Tactic: 6618077155362058131 Time: 0.0176305
[11/24/2022-12:13:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6618077155362058131
[11/24/2022-12:13:47] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:47] [V] [TRT] --------------- Timing Runner: node_of_730 (CaskConvolution)
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:47] [V] [TRT] Tactic: 424230345342282109 Time: 0.0186623
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0289509
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:13:47] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0180223
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:47] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0329975
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:13:47] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0223073
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0245044
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0290185
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0157189
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0327488
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:13:47] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0256251
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:13:47] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0225097
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:47] [V] [TRT] Tactic: -7272221766465547628 Time: 0.018236
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:47] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0183023
[11/24/2022-12:13:47] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:13:48] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0183337
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:13:48] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0137729
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:13:48] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0175228
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:13:48] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0287662
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:13:48] [V] [TRT] Tactic: -3514726588976755320 Time: 0.041208
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:13:48] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0152078
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:13:48] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0328082
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:48] [V] [TRT] Tactic: -1008204680238783384 Time: 0.01822
[11/24/2022-12:13:48] [V] [TRT] node_of_730 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:13:48] [V] [TRT] Tactic: -50323486981480818 Time: 0.0182606
[11/24/2022-12:13:48] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0137729
[11/24/2022-12:13:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:13:48] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(635712,1,7224,43) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(44352,1:16,504,3) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(29568,14784:32,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(635712,1,7224,43) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(44352,1:16,504,3) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(29568,14784:32,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:48] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:48] [V] [TRT] --------------- Timing Runner: node_of_739 (CudaDepthwiseConvolution)
[11/24/2022-12:13:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:48] [V] [TRT] --------------- Timing Runner: node_of_739 (FusedConvActConvolution)
[11/24/2022-12:13:48] [V] [TRT] Tactic: 589823 Time: 0.0755223
[11/24/2022-12:13:48] [V] [TRT] Tactic: 786431 Time: 0.0520823
[11/24/2022-12:13:48] [V] [TRT] Tactic: 1638399 Time: 0.0584731
[11/24/2022-12:13:48] [V] [TRT] Tactic: 2097151 Time: 0.0709379
[11/24/2022-12:13:48] [V] [TRT] Tactic: 3997695 Time: 0.0555002
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4194303 Time: 0.0498682
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4259839 Time: 0.0642179
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4587519 Time: 0.050435
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4915199 Time: 0.0572343
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4980735 Time: 0.0478095
[11/24/2022-12:13:48] [V] [TRT] Tactic: 5767167 Time: 0.184855
[11/24/2022-12:13:48] [V] [TRT] Tactic: 7012351 Time: 0.0707901
[11/24/2022-12:13:48] [V] [TRT] Tactic: 7143423 Time: 0.086992
[11/24/2022-12:13:48] [V] [TRT] Tactic: 8191999 Time: 0.0624366
[11/24/2022-12:13:48] [V] [TRT] Tactic: 9109503 Time: 0.07312
[11/24/2022-12:13:48] [V] [TRT] Tactic: 9568255 Time: 0.0568869
[11/24/2022-12:13:48] [V] [TRT] Tactic: 10354687 Time: 0.0631406
[11/24/2022-12:13:48] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0478095
[11/24/2022-12:13:48] [V] [TRT] --------------- Timing Runner: node_of_739 (CudnnConvolution)
[11/24/2022-12:13:48] [V] [TRT] Tactic: 0 Time: 0.0516465
[11/24/2022-12:13:48] [V] [TRT] Tactic: 1 Time: 0.0477958
[11/24/2022-12:13:48] [V] [TRT] Tactic: 2 Time: 0.0404869
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4 Time: 2.71304
[11/24/2022-12:13:48] [V] [TRT] Tactic: 5 Time: 0.207904
[11/24/2022-12:13:48] [V] [TRT] Tactic: 56 Time: 0.0478232
[11/24/2022-12:13:48] [V] [TRT] Tactic: 57 Time: 0.048288
[11/24/2022-12:13:48] [V] [TRT] Tactic: 58 Time: 0.0407291
[11/24/2022-12:13:48] [V] [TRT] Tactic: 60 Time: 2.72719
[11/24/2022-12:13:48] [V] [TRT] Tactic: 61 Time: 0.208745
[11/24/2022-12:13:48] [V] [TRT] Tactic: 112 Time: 0.0479604
[11/24/2022-12:13:48] [V] [TRT] Tactic: 113 Time: 0.0476373
[11/24/2022-12:13:48] [V] [TRT] Tactic: 114 Time: 0.0412514
[11/24/2022-12:13:48] [V] [TRT] Tactic: 116 Time: 2.68309
[11/24/2022-12:13:48] [V] [TRT] Tactic: 117 Time: 0.204818
[11/24/2022-12:13:48] [V] [TRT] Fastest Tactic: 2 Time: 0.0404869
[11/24/2022-12:13:48] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:48] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:48] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:13:48] [V] [TRT] Tactic: 621442388677115936 Time: 0.148069
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:13:48] [V] [TRT] Tactic: 1327459216264546184 Time: 0.07328
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:13:48] [V] [TRT] Tactic: 3377996665278764661 Time: 0.29211
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0847474
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0659764
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:13:48] [V] [TRT] Tactic: 4918658762935651592 Time: 0.141033
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:48] [V] [TRT] Tactic: 5779835512569528575 Time: 0.114903
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:13:48] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0999977
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:13:48] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0694964
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:13:48] [V] [TRT] Tactic: 8048119769507926928 Time: 0.146318
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:13:48] [V] [TRT] Tactic: 9151672657204310840 Time: 0.080624
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:13:48] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0778423
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:13:48] [V] [TRT] Tactic: -7491730084094677098 Time: 0.037424
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:48] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0406743
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:13:48] [V] [TRT] Tactic: -6273689210331812572 Time: 0.113568
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:13:48] [V] [TRT] Tactic: -4562045946847239058 Time: 0.145801
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:13:48] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0621714
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:13:48] [V] [TRT] Tactic: -2777237991111865351 Time: 0.156832
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:13:48] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0844891
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:13:48] [V] [TRT] Tactic: -1349585930542925704 Time: 0.101666
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:48] [V] [TRT] Tactic: -1123676555321336786 Time: 0.116313
[11/24/2022-12:13:48] [V] [TRT] node_of_739 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:49] [V] [TRT] Tactic: -701551393537224327 Time: 0.0669669
[11/24/2022-12:13:49] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.037424
[11/24/2022-12:13:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(635712,1,7224,43) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1162498931361159915 Time: 0.121851
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3887292144336338310 Time: 0.077424
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0723406
[11/24/2022-12:13:49] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0723406
[11/24/2022-12:13:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0600716
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2536540085349545921 Time: 0.059395
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0697036
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0819566
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:13:49] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0604282
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:13:49] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0687817
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:13:49] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0675109
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:13:49] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0945234
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:13:49] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0618103
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:13:49] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0566903
[11/24/2022-12:13:49] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0566903
[11/24/2022-12:13:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CudnnConvolution)
[11/24/2022-12:13:49] [V] [TRT] Tactic: 0 Time: 0.0486735
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1 Time: 0.0488549
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2 Time: 0.0406583
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4 Time: 2.64007
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5 Time: 0.157998
[11/24/2022-12:13:49] [V] [TRT] Tactic: 56 Time: 0.0488594
[11/24/2022-12:13:49] [V] [TRT] Tactic: 58 Time: 0.040184
[11/24/2022-12:13:49] [V] [TRT] Tactic: 60 Time: 2.60831
[11/24/2022-12:13:49] [V] [TRT] Tactic: 61 Time: 0.159502
[11/24/2022-12:13:49] [V] [TRT] Fastest Tactic: 58 Time: 0.040184
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 58
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (FusedConvActConvolution)
[11/24/2022-12:13:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0275688
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0949851
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4418200634486186714 Time: 0.04212
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0423566
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0419234
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:13:49] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0259177
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0715703
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0261905
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:49] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0957531
[11/24/2022-12:13:49] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0259177
[11/24/2022-12:13:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CudaDepthwiseConvolution)
[11/24/2022-12:13:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:49] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:49] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:49] [V] [TRT] Tactic: 254850674756030979 Time: 0.0353966
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0365566
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0276914
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0342482
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0210456
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0772914
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0420994
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0286254
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:49] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0438434
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0462229
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0297271
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0545158
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0678918
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:49] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0286181
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3071479995783211391 Time: 0.022577
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0171733
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0479284
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0383109
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:49] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0334491
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0635992
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0208849
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0306459
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0355209
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:49] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0329271
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0337883
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5070322914990170527 Time: 0.034763
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0301586
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0410686
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:49] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0308443
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0401851
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0340617
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0475851
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0475623
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0716777
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:49] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0400606
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:49] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0229179
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:49] [V] [TRT] Tactic: 7609923741161019135 Time: 0.026387
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:13:49] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0276922
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:49] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0453646
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:49] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0452251
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:13:49] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0307173
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:49] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0217221
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:49] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0325641
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:49] [V] [TRT] Tactic: -8604374562669615024 Time: 0.061725
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:13:49] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0337929
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:13:49] [V] [TRT] Tactic: -8205952393017864204 Time: 0.032139
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:13:49] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0236611
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:13:49] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0653623
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:13:49] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0313975
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:13:49] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0553021
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:49] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0729143
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:49] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0398377
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:49] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0305527
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:13:49] [V] [TRT] Tactic: -5409588854490562130 Time: 0.014832
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:49] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0302409
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:49] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0480853
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:49] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0421177
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:49] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0365851
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0264267
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0790766
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0425703
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0262903
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0376983
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0356407
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:49] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0647086
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:49] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0802149
[11/24/2022-12:13:49] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:49] [V] [TRT] Tactic: -3905653247016903130 Time: 0.033109
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0199143
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0209633
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3601464762214218301 Time: 0.039032
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0468309
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2878731503146438856 Time: 0.019272
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0445211
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288631
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0444571
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0387211
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0225091
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0276632
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1562548049711204899 Time: 0.028397
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0611276
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0570484
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0374617
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:13:50] [V] [TRT] Tactic: -406984317033388136 Time: 0.0329326
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:13:50] [V] [TRT] Tactic: -331499326992534460 Time: 0.024819
[11/24/2022-12:13:50] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.014832
[11/24/2022-12:13:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(44352,1:16,504,3) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CublasConvolution)
[11/24/2022-12:13:50] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CudaDepthwiseConvolution)
[11/24/2022-12:13:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:50] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0613501
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:13:50] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0612571
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:50] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0621029
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0260008
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342427
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:13:50] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208549
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:50] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0344064
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:13:50] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0260975
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0211886
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0262819
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:50] [V] [TRT] Tactic: -108011214168778087 Time: 0.0207158
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:13:50] [V] [TRT] Tactic: -42427192380281294 Time: 0.0340983
[11/24/2022-12:13:50] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0207158
[11/24/2022-12:13:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:13:50] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0157381
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0160518
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:13:50] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0179309
[11/24/2022-12:13:50] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0157381
[11/24/2022-12:13:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(29568,14784:32,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:13:50] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0189503
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:13:50] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0204859
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4178917718361232468 Time: 0.02456
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5012796702462679112 Time: 0.032459
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:50] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0308059
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:13:50] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0196326
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:13:50] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0406903
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:13:50] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0268411
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:13:50] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0259459
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:50] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0308608
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:13:50] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0324014
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:50] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0242027
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:50] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0330935
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:13:50] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0203869
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:50] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0244259
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:13:50] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0304622
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0309193
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0245752
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0246644
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0234064
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0242408
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:50] [V] [TRT] Tactic: -621838502160440068 Time: 0.0252472
[11/24/2022-12:13:50] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0189503
[11/24/2022-12:13:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_739 (CaskConvolution)
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:50] [V] [TRT] Tactic: 424230345342282109 Time: 0.0204989
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:50] [V] [TRT] Tactic: 2327398338581585326 Time: 0.030507
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:13:50] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0179966
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0342327
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0231334
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0259223
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0300782
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0153051
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0340955
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7563002870293617494 Time: 0.026189
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:13:50] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0235605
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:50] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0204793
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:50] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0200726
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:13:50] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0182286
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:13:50] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0149797
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0178011
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0290286
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:13:50] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0422617
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:13:50] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0152809
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1712174008006584201 Time: 0.032437
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:50] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0192303
[11/24/2022-12:13:50] [V] [TRT] node_of_739 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:13:50] [V] [TRT] Tactic: -50323486981480818 Time: 0.018636
[11/24/2022-12:13:50] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0149797
[11/24/2022-12:13:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:13:50] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(635712,1,7224,43) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(44352,1:16,504,3) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(29568,14784:32,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(29568,14784:32,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:50] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_745 (CudaDepthwiseConvolution)
[11/24/2022-12:13:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:50] [V] [TRT] --------------- Timing Runner: node_of_745 (FusedConvActConvolution)
[11/24/2022-12:13:50] [V] [TRT] Tactic: 589823 Time: 0.286606
[11/24/2022-12:13:50] [V] [TRT] Tactic: 655359 Time: 0.233134
[11/24/2022-12:13:50] [V] [TRT] Tactic: 786431 Time: 0.162944
[11/24/2022-12:13:50] [V] [TRT] Tactic: 851967 Time: 0.268603
[11/24/2022-12:13:50] [V] [TRT] Tactic: 1179647 Time: 0.154729
[11/24/2022-12:13:50] [V] [TRT] Tactic: 1638399 Time: 0.160503
[11/24/2022-12:13:50] [V] [TRT] Tactic: 2097151 Time: 0.143611
[11/24/2022-12:13:50] [V] [TRT] Tactic: 3538943 Time: 0.154272
[11/24/2022-12:13:50] [V] [TRT] Tactic: 3932159 Time: 0.238048
[11/24/2022-12:13:50] [V] [TRT] Tactic: 3997695 Time: 0.154651
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4194303 Time: 0.163383
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4259839 Time: 0.134402
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4587519 Time: 0.150313
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4653055 Time: 0.157394
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4915199 Time: 0.150249
[11/24/2022-12:13:50] [V] [TRT] Tactic: 4980735 Time: 0.174126
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5177343 Time: 0.160311
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5242879 Time: 0.170231
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5373951 Time: 0.175744
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5570559 Time: 0.233518
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5767167 Time: 0.295593
[11/24/2022-12:13:50] [V] [TRT] Tactic: 5898239 Time: 0.15355
[11/24/2022-12:13:50] [V] [TRT] Tactic: 6225919 Time: 0.157591
[11/24/2022-12:13:50] [V] [TRT] Tactic: 6291455 Time: 0.157303
[11/24/2022-12:13:50] [V] [TRT] Tactic: 6815743 Time: 0.176786
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7012351 Time: 0.144055
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7077887 Time: 0.1504
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7143423 Time: 0.229307
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7208959 Time: 0.170921
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7340031 Time: 0.158391
[11/24/2022-12:13:50] [V] [TRT] Tactic: 7536639 Time: 0.305426
[11/24/2022-12:13:51] [V] [TRT] Tactic: 7733247 Time: 0.149536
[11/24/2022-12:13:51] [V] [TRT] Tactic: 8191999 Time: 0.183653
[11/24/2022-12:13:51] [V] [TRT] Tactic: 8716287 Time: 0.173586
[11/24/2022-12:13:51] [V] [TRT] Tactic: 9109503 Time: 0.147474
[11/24/2022-12:13:51] [V] [TRT] Tactic: 9568255 Time: 0.148411
[11/24/2022-12:13:51] [V] [TRT] Tactic: 10354687 Time: 0.147163
[11/24/2022-12:13:51] [V] [TRT] Tactic: 10747903 Time: 0.146917
[11/24/2022-12:13:51] [V] [TRT] Fastest Tactic: 4259839 Time: 0.134402
[11/24/2022-12:13:51] [V] [TRT] --------------- Timing Runner: node_of_745 (CudnnConvolution)
[11/24/2022-12:13:51] [V] [TRT] Tactic: 0 Time: 0.0783246
[11/24/2022-12:13:51] [V] [TRT] Tactic: 1 Time: 0.0675901
[11/24/2022-12:13:51] [V] [TRT] Tactic: 2 Time: 0.161362
[11/24/2022-12:13:51] [V] [TRT] Tactic: 4 Time: 29.1206
[11/24/2022-12:13:51] [V] [TRT] Tactic: 5 Time: 0.257083
[11/24/2022-12:13:51] [V] [TRT] Tactic: 56 Time: 0.0678004
[11/24/2022-12:13:51] [V] [TRT] Tactic: 57 Time: 0.0619977
[11/24/2022-12:13:51] [V] [TRT] Tactic: 58 Time: 0.133168
[11/24/2022-12:13:52] [V] [TRT] Tactic: 60 Time: 22.1217
[11/24/2022-12:13:52] [V] [TRT] Tactic: 61 Time: 0.261321
[11/24/2022-12:13:52] [V] [TRT] Tactic: 112 Time: 0.0727314
[11/24/2022-12:13:52] [V] [TRT] Tactic: 113 Time: 0.077664
[11/24/2022-12:13:52] [V] [TRT] Tactic: 114 Time: 0.135591
[11/24/2022-12:13:52] [V] [TRT] Tactic: 116 Time: 22.5911
[11/24/2022-12:13:52] [V] [TRT] Tactic: 117 Time: 0.260178
[11/24/2022-12:13:52] [V] [TRT] Fastest Tactic: 57 Time: 0.0619977
[11/24/2022-12:13:52] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:52] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:13:52] [V] [TRT] Tactic: 621442388677115936 Time: 0.156645
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:13:52] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0848594
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:13:52] [V] [TRT] Tactic: 3377996665278764661 Time: 0.292274
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:13:52] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0932046
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:52] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0689844
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:13:52] [V] [TRT] Tactic: 4918658762935651592 Time: 0.145015
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:52] [V] [TRT] Tactic: 5779835512569528575 Time: 0.118384
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:13:52] [V] [TRT] Tactic: 5837905844602864231 Time: 0.113874
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:13:52] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0824366
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:13:52] [V] [TRT] Tactic: 8048119769507926928 Time: 0.156974
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:13:52] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0892891
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:13:52] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0810217
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:13:52] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0412046
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:52] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0448057
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:13:52] [V] [TRT] Tactic: -6273689210331812572 Time: 0.116937
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:13:52] [V] [TRT] Tactic: -4562045946847239058 Time: 0.155374
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:13:52] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0653288
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:13:52] [V] [TRT] Tactic: -2777237991111865351 Time: 0.161911
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:13:52] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0891589
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:13:52] [V] [TRT] Tactic: -1349585930542925704 Time: 0.112203
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:52] [V] [TRT] Tactic: -1123676555321336786 Time: 0.118928
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:52] [V] [TRT] Tactic: -701551393537224327 Time: 0.0702339
[11/24/2022-12:13:52] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0412046
[11/24/2022-12:13:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:13:52] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(473088,1,5376,32) ***************
[11/24/2022-12:13:52] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:52] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:13:52] [V] [TRT] Tactic: 1162498931361159915 Time: 0.118569
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:13:52] [V] [TRT] Tactic: 1663866669559596164 Time: 0.104386
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:13:52] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0734217
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:13:52] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0729509
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:13:52] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0569448
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:13:52] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0569905
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:13:52] [V] [TRT] Tactic: 4696204239951173149 Time: 0.07392
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:13:52] [V] [TRT] Tactic: 5778138195697110003 Time: 0.106258
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:13:52] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0700465
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:13:52] [V] [TRT] Tactic: 8918020581761223752 Time: 0.104642
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:13:52] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0692983
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:13:52] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0550644
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:13:52] [V] [TRT] Tactic: -2809379259463049391 Time: 0.10728
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:13:52] [V] [TRT] Tactic: -1985235291706575900 Time: 0.103182
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:13:52] [V] [TRT] Tactic: -504296718212024303 Time: 0.105095
[11/24/2022-12:13:52] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0550644
[11/24/2022-12:13:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:13:52] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(118272,1:4,1344,8) ***************
[11/24/2022-12:13:52] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:52] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:52] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:13:52] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0535939
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:13:52] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0525242
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:13:52] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0666301
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:13:52] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0774697
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:13:52] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0552091
[11/24/2022-12:13:52] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:13:53] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0648808
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:13:53] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0612632
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:13:53] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0908091
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:13:53] [V] [TRT] Tactic: -1366318165940453381 Time: 0.057437
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:13:53] [V] [TRT] Tactic: -1138876066247138089 Time: 0.053021
[11/24/2022-12:13:53] [V] [TRT] Fastest Tactic: 2536540085349545921 Time: 0.0525242
[11/24/2022-12:13:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2536540085349545921
[11/24/2022-12:13:53] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CudnnConvolution)
[11/24/2022-12:13:53] [V] [TRT] Tactic: 0 Time: 0.0587169
[11/24/2022-12:13:53] [V] [TRT] Tactic: 1 Time: 0.0859794
[11/24/2022-12:13:53] [V] [TRT] Tactic: 2 Time: 0.179008
[11/24/2022-12:13:53] [V] [TRT] Tactic: 4 Time: 23.3171
[11/24/2022-12:13:53] [V] [TRT] Tactic: 5 Time: 0.255104
[11/24/2022-12:13:53] [V] [TRT] Tactic: 56 Time: 0.0584549
[11/24/2022-12:13:53] [V] [TRT] Tactic: 58 Time: 0.182615
[11/24/2022-12:13:53] [V] [TRT] Tactic: 60 Time: 22.6185
[11/24/2022-12:13:53] [V] [TRT] Tactic: 61 Time: 0.250912
[11/24/2022-12:13:53] [V] [TRT] Fastest Tactic: 56 Time: 0.0584549
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:13:53] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784:2,168,1) ***************
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (FusedConvActConvolution)
[11/24/2022-12:13:53] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:53] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0264678
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:53] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0935497
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:13:53] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0410651
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:53] [V] [TRT] Tactic: 5548126322150286555 Time: 0.041016
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:53] [V] [TRT] Tactic: 6057304366605292508 Time: 0.039328
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:13:53] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0245768
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:13:53] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0701013
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:53] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0263581
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:53] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0938491
[11/24/2022-12:13:53] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0245768
[11/24/2022-12:13:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:13:53] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:53] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(59136,1:8,672,4) ***************
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CudaDepthwiseConvolution)
[11/24/2022-12:13:53] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:53] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:53] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:53] [V] [TRT] Tactic: 254850674756030979 Time: 0.0327918
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:53] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0338999
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:13:53] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0266324
[11/24/2022-12:13:53] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0328704
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0198589
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0755703
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0402194
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0269874
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0432811
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0457451
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0288046
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0534629
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0664579
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0284175
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0211873
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0154976
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0476194
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0350766
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0328933
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0625387
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0204624
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0289563
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0343433
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0286574
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0329829
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0331163
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0276549
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0398686
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0297518
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0390434
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0328914
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0453657
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0453897
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0706987
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0394514
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0202274
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0265707
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:13:54] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0266339
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:54] [V] [TRT] Tactic: 8101703987960976805 Time: 0.044176
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:54] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0435886
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:13:54] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0288677
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:54] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0202491
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:54] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0290514
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:54] [V] [TRT] Tactic: -8604374562669615024 Time: 0.06032
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:13:54] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0327104
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:13:54] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0306441
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:13:54] [V] [TRT] Tactic: -8131857373260504832 Time: 0.022014
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0644404
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0308407
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0536838
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:54] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0705265
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:54] [V] [TRT] Tactic: -6063766379489217211 Time: 0.039176
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5530886555766748586 Time: 0.028608
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0139362
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0286071
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0475794
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0393383
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0349733
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4950923835688973492 Time: 0.024816
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0767154
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0412926
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0244442
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0370023
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0341358
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0641387
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0787543
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3905653247016903130 Time: 0.030507
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0184349
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0201903
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3601464762214218301 Time: 0.039064
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0467051
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0179983
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0436149
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0285973
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0414091
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0372709
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0202737
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0266415
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0266103
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0601097
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0557669
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0372697
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:13:54] [V] [TRT] Tactic: -406984317033388136 Time: 0.0312302
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:13:54] [V] [TRT] Tactic: -331499326992534460 Time: 0.0246324
[11/24/2022-12:13:54] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0139362
[11/24/2022-12:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CublasConvolution)
[11/24/2022-12:13:54] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:54] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CudaDepthwiseConvolution)
[11/24/2022-12:13:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0607573
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0610865
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0617234
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0248876
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0335835
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:13:54] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0206296
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0337591
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:13:54] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0249394
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0206746
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0257859
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:54] [V] [TRT] Tactic: -108011214168778087 Time: 0.02051
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:13:54] [V] [TRT] Tactic: -42427192380281294 Time: 0.0333961
[11/24/2022-12:13:54] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.02051
[11/24/2022-12:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0203909
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0230021
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0216562
[11/24/2022-12:13:54] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0203909
[11/24/2022-12:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2818014835119698671 Time: 0.017858
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:13:54] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0184623
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0233731
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0319086
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0298661
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0176762
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:13:54] [V] [TRT] Tactic: 6969462133921577484 Time: 0.039696
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:13:54] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0256259
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:13:54] [V] [TRT] Tactic: -8893439100868426414 Time: 0.02472
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0294171
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0321015
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0230968
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0323154
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:13:54] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0194143
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0233084
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0290231
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0299447
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0235265
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0233678
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0232157
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0233149
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:54] [V] [TRT] Tactic: -621838502160440068 Time: 0.0247855
[11/24/2022-12:13:54] [V] [TRT] Fastest Tactic: 6618077155362058131 Time: 0.0176762
[11/24/2022-12:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6618077155362058131
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_745 (CaskConvolution)
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:54] [V] [TRT] Tactic: 424230345342282109 Time: 0.0196263
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0306167
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0182017
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:54] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0332379
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:13:54] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0224313
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0246705
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0293577
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7507411019787288861 Time: 0.015605
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0329883
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:13:54] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0260891
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:13:54] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0223882
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:54] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0182977
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:54] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0183566
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0182446
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:13:54] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0138273
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0177818
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0287726
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:13:54] [V] [TRT] Tactic: -3514726588976755320 Time: 0.04124
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:13:54] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0154258
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0324023
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:54] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0180697
[11/24/2022-12:13:54] [V] [TRT] node_of_745 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:13:54] [V] [TRT] Tactic: -50323486981480818 Time: 0.0182491
[11/24/2022-12:13:54] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0138273
[11/24/2022-12:13:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:13:54] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:54] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_748 (CudaDepthwiseConvolution)
[11/24/2022-12:13:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:54] [V] [TRT] --------------- Timing Runner: node_of_748 (FusedConvActConvolution)
[11/24/2022-12:13:54] [V] [TRT] Tactic: 589823 Time: 0.105899
[11/24/2022-12:13:54] [V] [TRT] Tactic: 786431 Time: 0.0577478
[11/24/2022-12:13:54] [V] [TRT] Tactic: 1638399 Time: 0.0739337
[11/24/2022-12:13:54] [V] [TRT] Tactic: 2097151 Time: 0.0784206
[11/24/2022-12:13:55] [V] [TRT] Tactic: 3997695 Time: 0.0609631
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4194303 Time: 0.0579078
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4259839 Time: 0.074
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4587519 Time: 0.0555352
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4915199 Time: 0.0653303
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4980735 Time: 0.0581623
[11/24/2022-12:13:55] [V] [TRT] Tactic: 5767167 Time: 0.186437
[11/24/2022-12:13:55] [V] [TRT] Tactic: 7012351 Time: 0.0817394
[11/24/2022-12:13:55] [V] [TRT] Tactic: 7143423 Time: 0.122976
[11/24/2022-12:13:55] [V] [TRT] Tactic: 8191999 Time: 0.0689417
[11/24/2022-12:13:55] [V] [TRT] Tactic: 9109503 Time: 0.0783406
[11/24/2022-12:13:55] [V] [TRT] Tactic: 9568255 Time: 0.0681539
[11/24/2022-12:13:55] [V] [TRT] Tactic: 10354687 Time: 0.0647939
[11/24/2022-12:13:55] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0555352
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CudnnConvolution)
[11/24/2022-12:13:55] [V] [TRT] Tactic: 0 Time: 0.0504716
[11/24/2022-12:13:55] [V] [TRT] Tactic: 1 Time: 0.05024
[11/24/2022-12:13:55] [V] [TRT] Tactic: 2 Time: 0.127655
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4 Time: 3.45922
[11/24/2022-12:13:55] [V] [TRT] Tactic: 5 Time: 0.225157
[11/24/2022-12:13:55] [V] [TRT] Tactic: 56 Time: 0.0495375
[11/24/2022-12:13:55] [V] [TRT] Tactic: 57 Time: 0.0517714
[11/24/2022-12:13:55] [V] [TRT] Tactic: 58 Time: 0.124603
[11/24/2022-12:13:55] [V] [TRT] Tactic: 60 Time: 3.44606
[11/24/2022-12:13:55] [V] [TRT] Tactic: 61 Time: 0.226885
[11/24/2022-12:13:55] [V] [TRT] Tactic: 112 Time: 0.0515627
[11/24/2022-12:13:55] [V] [TRT] Tactic: 113 Time: 0.0510811
[11/24/2022-12:13:55] [V] [TRT] Tactic: 114 Time: 0.130398
[11/24/2022-12:13:55] [V] [TRT] Tactic: 116 Time: 3.43837
[11/24/2022-12:13:55] [V] [TRT] Tactic: 117 Time: 0.224581
[11/24/2022-12:13:55] [V] [TRT] Fastest Tactic: 56 Time: 0.0495375
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:13:55] [V] [TRT] Tactic: 621442388677115936 Time: 0.155621
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:13:55] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0850263
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:13:55] [V] [TRT] Tactic: 3377996665278764661 Time: 0.290272
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0910263
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0655131
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4918658762935651592 Time: 0.141234
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:55] [V] [TRT] Tactic: 5779835512569528575 Time: 0.114791
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:13:55] [V] [TRT] Tactic: 5837905844602864231 Time: 0.100578
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:13:55] [V] [TRT] Tactic: 6210049212073459059 Time: 0.073472
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:13:55] [V] [TRT] Tactic: 8048119769507926928 Time: 0.150427
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:13:55] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0798194
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:13:55] [V] [TRT] Tactic: -8766093103475083267 Time: 0.080576
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:13:55] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0381143
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:55] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0423166
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:13:55] [V] [TRT] Tactic: -6273689210331812572 Time: 0.11376
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:13:55] [V] [TRT] Tactic: -4562045946847239058 Time: 0.148805
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:13:55] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0622811
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:13:55] [V] [TRT] Tactic: -2777237991111865351 Time: 0.15872
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:13:55] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0850194
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:13:55] [V] [TRT] Tactic: -1349585930542925704 Time: 0.112231
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:55] [V] [TRT] Tactic: -1123676555321336786 Time: 0.118939
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:55] [V] [TRT] Tactic: -701551393537224327 Time: 0.0681691
[11/24/2022-12:13:55] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0381143
[11/24/2022-12:13:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:13:55] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(473088,1,5376,32) ***************
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:13:55] [V] [TRT] Tactic: 1162498931361159915 Time: 0.118981
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:13:55] [V] [TRT] Tactic: 1663866669559596164 Time: 0.104322
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:13:55] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0732412
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:13:55] [V] [TRT] Tactic: 3887292144336338310 Time: 0.071101
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0549912
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4479823862704990365 Time: 0.054883
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:13:55] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0727634
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:13:55] [V] [TRT] Tactic: 5778138195697110003 Time: 0.105328
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:13:55] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0685333
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:13:55] [V] [TRT] Tactic: 8918020581761223752 Time: 0.103957
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:13:55] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0681859
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:13:55] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0532617
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:13:55] [V] [TRT] Tactic: -2809379259463049391 Time: 0.106507
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:13:55] [V] [TRT] Tactic: -1985235291706575900 Time: 0.102578
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:13:55] [V] [TRT] Tactic: -504296718212024303 Time: 0.103979
[11/24/2022-12:13:55] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0532617
[11/24/2022-12:13:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:13:55] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(118272,1:4,1344,8) ***************
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:55] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:55] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:13:55] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0511421
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:13:55] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0493806
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:13:55] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0649722
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:13:55] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0755771
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:13:55] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0545371
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:13:55] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0636952
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:13:55] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0585402
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:13:55] [V] [TRT] Tactic: -1450865838092804082 Time: 0.089248
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:13:55] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0553539
[11/24/2022-12:13:55] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0510842
[11/24/2022-12:13:56] [V] [TRT] Fastest Tactic: 2536540085349545921 Time: 0.0493806
[11/24/2022-12:13:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2536540085349545921
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CudnnConvolution)
[11/24/2022-12:13:56] [V] [TRT] Tactic: 0 Time: 0.0483962
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1 Time: 0.0483825
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2 Time: 0.0988137
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4 Time: 3.52272
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5 Time: 0.184905
[11/24/2022-12:13:56] [V] [TRT] Tactic: 56 Time: 0.0485029
[11/24/2022-12:13:56] [V] [TRT] Tactic: 58 Time: 0.0996137
[11/24/2022-12:13:56] [V] [TRT] Tactic: 60 Time: 3.56724
[11/24/2022-12:13:56] [V] [TRT] Tactic: 61 Time: 0.184421
[11/24/2022-12:13:56] [V] [TRT] Fastest Tactic: 1 Time: 0.0483825
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784:2,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (FusedConvActConvolution)
[11/24/2022-12:13:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0266499
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0936731
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0409863
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0410846
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0393977
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:13:56] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0245455
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0700267
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0263063
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0938583
[11/24/2022-12:13:56] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0245455
[11/24/2022-12:13:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(59136,1:8,672,4) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CudaDepthwiseConvolution)
[11/24/2022-12:13:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:56] [V] [TRT] Tactic: 254850674756030979 Time: 0.0329207
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0347941
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0263756
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0328914
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0198211
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0749486
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1832046141070096030 Time: 0.040752
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0265417
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0431531
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0455189
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2541579301352125276 Time: 0.028757
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0535665
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0664549
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0284625
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0203503
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0146912
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0475417
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3513075359009385578 Time: 0.034848
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0327982
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4278315135102886928 Time: 0.062208
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0201474
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0296018
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0335387
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:56] [V] [TRT] Tactic: 4802447371470387646 Time: 0.028597
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0327515
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0331922
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5205510332404400949 Time: 0.027696
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0408651
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0303552
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0393909
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6372404953297521067 Time: 0.033003
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0473554
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0476998
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0721257
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:56] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0396663
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:56] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0228487
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:56] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0261669
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:13:56] [V] [TRT] Tactic: 8095507026323593899 Time: 0.026531
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:56] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0450217
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:56] [V] [TRT] Tactic: 8170606396342855895 Time: 0.044816
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:13:56] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0311195
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:56] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0208842
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:56] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0324151
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:56] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0612617
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:13:56] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0328274
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:13:56] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0313966
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:13:56] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0227553
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:13:56] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0641813
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:13:56] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0315721
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:13:56] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0540648
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:56] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0720091
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:56] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0394469
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0288366
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0150144
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0287442
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0476556
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5127240325355316006 Time: 0.04016
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0369211
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4950923835688973492 Time: 0.026083
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4796511246675321840 Time: 0.078144
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0424149
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0260815
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0370171
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0343397
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0642636
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:56] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0804571
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:56] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0313902
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:13:56] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0202531
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:56] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0206165
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:56] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0375429
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:56] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0477303
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:13:56] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0192171
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:13:56] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0450937
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:13:56] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0289381
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:13:56] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0425314
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:13:56] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0381931
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208183
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1640527254204634147 Time: 0.026419
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0287909
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1242202084391243207 Time: 0.061216
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1099247066487349374 Time: 0.056963
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0369349
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:13:56] [V] [TRT] Tactic: -406984317033388136 Time: 0.0317577
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:13:56] [V] [TRT] Tactic: -331499326992534460 Time: 0.025923
[11/24/2022-12:13:56] [V] [TRT] Fastest Tactic: 3359475309458902373 Time: 0.0146912
[11/24/2022-12:13:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3359475309458902373
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CublasConvolution)
[11/24/2022-12:13:56] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CudaDepthwiseConvolution)
[11/24/2022-12:13:56] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:56] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0615893
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:13:56] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0614187
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0619596
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:56] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259642
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:56] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0343707
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:13:56] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0207628
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:56] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0344978
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:13:56] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0259771
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:56] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0211997
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:56] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0261204
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:56] [V] [TRT] Tactic: -108011214168778087 Time: 0.0208712
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:13:56] [V] [TRT] Tactic: -42427192380281294 Time: 0.0340535
[11/24/2022-12:13:56] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0207628
[11/24/2022-12:13:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:13:56] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:56] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:13:56] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0158745
[11/24/2022-12:13:56] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0166364
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:13:57] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0178629
[11/24/2022-12:13:57] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0158745
[11/24/2022-12:13:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:13:57] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:13:57] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0186697
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:13:57] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0204109
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0243886
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0325239
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:57] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0307026
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:13:57] [V] [TRT] Tactic: 6618077155362058131 Time: 0.019664
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:13:57] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0407714
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:13:57] [V] [TRT] Tactic: -8912999970161746151 Time: 0.026259
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:13:57] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0258552
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:57] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0304539
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:13:57] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0325413
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:57] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0240815
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:57] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0327378
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:13:57] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0199171
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:57] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0241524
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:13:57] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0299099
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:13:57] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0306258
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:13:57] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0247139
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:13:57] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0236604
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:13:57] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0249905
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:57] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0239718
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:57] [V] [TRT] Tactic: -621838502160440068 Time: 0.0258461
[11/24/2022-12:13:57] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0186697
[11/24/2022-12:13:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:13:57] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_748 (CaskConvolution)
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:57] [V] [TRT] Tactic: 424230345342282109 Time: 0.0204415
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:57] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0310811
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:13:57] [V] [TRT] Tactic: 2881044142075831475 Time: 0.018112
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0341797
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0231954
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0257943
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0302702
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0154126
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0341358
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7563002870293617494 Time: 0.026016
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:13:57] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0232274
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:57] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0204767
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:57] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0200097
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:13:57] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0182543
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:13:57] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0149783
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:13:57] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0179989
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:13:57] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0291063
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:13:57] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0425566
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:13:57] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0154331
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:13:57] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0331118
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:57] [V] [TRT] Tactic: -1008204680238783384 Time: 0.019692
[11/24/2022-12:13:57] [V] [TRT] node_of_748 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:13:57] [V] [TRT] Tactic: -50323486981480818 Time: 0.0185926
[11/24/2022-12:13:57] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0149783
[11/24/2022-12:13:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:13:57] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:57] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_751 (CudaDepthwiseConvolution)
[11/24/2022-12:13:57] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_751 (FusedConvActConvolution)
[11/24/2022-12:13:57] [V] [TRT] Tactic: 589823 Time: 0.0785714
[11/24/2022-12:13:57] [V] [TRT] Tactic: 786431 Time: 0.0534248
[11/24/2022-12:13:57] [V] [TRT] Tactic: 1638399 Time: 0.0587718
[11/24/2022-12:13:57] [V] [TRT] Tactic: 2097151 Time: 0.0696853
[11/24/2022-12:13:57] [V] [TRT] Tactic: 3997695 Time: 0.0574263
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4194303 Time: 0.050083
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4259839 Time: 0.0640488
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4587519 Time: 0.0504061
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4915199 Time: 0.0561829
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4980735 Time: 0.0477943
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5767167 Time: 0.190405
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7012351 Time: 0.0714994
[11/24/2022-12:13:57] [V] [TRT] Tactic: 7143423 Time: 0.0850629
[11/24/2022-12:13:57] [V] [TRT] Tactic: 8191999 Time: 0.06144
[11/24/2022-12:13:57] [V] [TRT] Tactic: 9109503 Time: 0.0759406
[11/24/2022-12:13:57] [V] [TRT] Tactic: 9568255 Time: 0.0587672
[11/24/2022-12:13:57] [V] [TRT] Tactic: 10354687 Time: 0.0625204
[11/24/2022-12:13:57] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0477943
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_751 (CudnnConvolution)
[11/24/2022-12:13:57] [V] [TRT] Tactic: 0 Time: 0.0488869
[11/24/2022-12:13:57] [V] [TRT] Tactic: 1 Time: 0.0480152
[11/24/2022-12:13:57] [V] [TRT] Tactic: 2 Time: 0.0407749
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4 Time: 2.74535
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5 Time: 0.207831
[11/24/2022-12:13:57] [V] [TRT] Tactic: 56 Time: 0.0474217
[11/24/2022-12:13:57] [V] [TRT] Tactic: 57 Time: 0.048035
[11/24/2022-12:13:57] [V] [TRT] Tactic: 58 Time: 0.0459726
[11/24/2022-12:13:57] [V] [TRT] Tactic: 60 Time: 2.7112
[11/24/2022-12:13:57] [V] [TRT] Tactic: 61 Time: 0.207611
[11/24/2022-12:13:57] [V] [TRT] Tactic: 112 Time: 0.0476069
[11/24/2022-12:13:57] [V] [TRT] Tactic: 113 Time: 0.0480716
[11/24/2022-12:13:57] [V] [TRT] Tactic: 114 Time: 0.040584
[11/24/2022-12:13:57] [V] [TRT] Tactic: 116 Time: 2.69355
[11/24/2022-12:13:57] [V] [TRT] Tactic: 117 Time: 0.210222
[11/24/2022-12:13:57] [V] [TRT] Fastest Tactic: 114 Time: 0.040584
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:57] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:57] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:13:57] [V] [TRT] Tactic: 621442388677115936 Time: 0.149047
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:13:57] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0731611
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:13:57] [V] [TRT] Tactic: 3377996665278764661 Time: 0.292197
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0858103
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0673067
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:13:57] [V] [TRT] Tactic: 4918658762935651592 Time: 0.140512
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5779835512569528575 Time: 0.115008
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:13:57] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0982331
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:13:57] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0681798
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:13:57] [V] [TRT] Tactic: 8048119769507926928 Time: 0.147867
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:13:57] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0809966
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:13:57] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0784114
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:13:57] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0372606
[11/24/2022-12:13:57] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:13:57] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0401909
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:13:58] [V] [TRT] Tactic: -6273689210331812572 Time: 0.113381
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:13:58] [V] [TRT] Tactic: -4562045946847239058 Time: 0.156251
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:13:58] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0613211
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:13:58] [V] [TRT] Tactic: -2777237991111865351 Time: 0.157097
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0856229
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1349585930542925704 Time: 0.101591
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1123676555321336786 Time: 0.115753
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:13:58] [V] [TRT] Tactic: -701551393537224327 Time: 0.0684053
[11/24/2022-12:13:58] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0372606
[11/24/2022-12:13:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(473088,1,5376,32) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122238
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1663866669559596164 Time: 0.107847
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0767497
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0780206
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0624
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0625234
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4696204239951173149 Time: 0.077168
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5778138195697110003 Time: 0.109856
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0725829
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:13:58] [V] [TRT] Tactic: 8918020581761223752 Time: 0.107458
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:13:58] [V] [TRT] Tactic: -5905193483742532701 Time: 0.075232
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:13:58] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0607451
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:13:58] [V] [TRT] Tactic: -2809379259463049391 Time: 0.109733
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1985235291706575900 Time: 0.105762
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:13:58] [V] [TRT] Tactic: -504296718212024303 Time: 0.107799
[11/24/2022-12:13:58] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0607451
[11/24/2022-12:13:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(118272,1:4,1344,8) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0611383
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0612343
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0694324
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0817326
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:13:58] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0597074
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:13:58] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0690255
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:13:58] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0680945
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0936411
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0623299
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0570804
[11/24/2022-12:13:58] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0570804
[11/24/2022-12:13:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CudnnConvolution)
[11/24/2022-12:13:58] [V] [TRT] Tactic: 0 Time: 0.049152
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1 Time: 0.0500038
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2 Time: 0.0401749
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4 Time: 2.61004
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5 Time: 0.157769
[11/24/2022-12:13:58] [V] [TRT] Tactic: 56 Time: 0.0491002
[11/24/2022-12:13:58] [V] [TRT] Tactic: 58 Time: 0.0403154
[11/24/2022-12:13:58] [V] [TRT] Tactic: 60 Time: 2.63625
[11/24/2022-12:13:58] [V] [TRT] Tactic: 61 Time: 0.157225
[11/24/2022-12:13:58] [V] [TRT] Fastest Tactic: 2 Time: 0.0401749
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784:2,168,1) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (FusedConvActConvolution)
[11/24/2022-12:13:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0283573
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0961189
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0425006
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0423269
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0414583
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:13:58] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0260152
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:13:58] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0717371
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:13:58] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0261775
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:13:58] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0960869
[11/24/2022-12:13:58] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0260152
[11/24/2022-12:13:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(59136,1:8,672,4) ***************
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CudaDepthwiseConvolution)
[11/24/2022-12:13:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:58] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:13:58] [V] [TRT] Tactic: 254850674756030979 Time: 0.0343525
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0362126
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0267314
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0342766
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0207954
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0780069
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0424949
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1838082074606840426 Time: 0.028693
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:13:58] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0448274
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0454891
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0290871
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0531337
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0666133
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:13:58] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0287826
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0210932
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0153751
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0479147
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0345051
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:13:58] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0338048
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0635962
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0205773
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0290341
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0343762
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:13:58] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0288411
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0341065
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0343131
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0287762
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0401314
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:13:58] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0312091
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0395051
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0341879
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0472046
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0469577
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0720251
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:13:58] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0398309
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:13:58] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0208744
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:13:58] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0262636
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:13:58] [V] [TRT] Tactic: 8095507026323593899 Time: 0.026483
[11/24/2022-12:13:58] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:13:58] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0450263
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:13:59] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0452011
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:13:59] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0301221
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:13:59] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207582
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:13:59] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0300123
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:13:59] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0612587
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:13:59] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0326226
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:13:59] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0313618
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:13:59] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0230896
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7410012245391920273 Time: 0.064253
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0315109
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0540709
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:13:59] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0719634
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:13:59] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0398343
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0287899
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5409588854490562130 Time: 0.015051
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0290121
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0479223
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0403886
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0362171
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0262522
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0774354
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4548822885169694805 Time: 0.04248
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0261036
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371143
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0342126
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0645257
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0801349
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314203
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0203743
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207314
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0396857
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476358
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0179269
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2602982885923184927 Time: 0.045104
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0289445
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0424229
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0382594
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0214178
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0264312
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0287826
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0612282
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0573074
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0369829
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:13:59] [V] [TRT] Tactic: -406984317033388136 Time: 0.0317422
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:13:59] [V] [TRT] Tactic: -331499326992534460 Time: 0.025645
[11/24/2022-12:13:59] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.015051
[11/24/2022-12:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CublasConvolution)
[11/24/2022-12:13:59] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:59] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CudaDepthwiseConvolution)
[11/24/2022-12:13:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:13:59] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0619017
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:13:59] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0615131
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:13:59] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0624899
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259596
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:13:59] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342921
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:13:59] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208647
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5576936487443445631 Time: 0.034368
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:13:59] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0259954
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2297737319934264721 Time: 0.021186
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0261227
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:13:59] [V] [TRT] Tactic: -108011214168778087 Time: 0.0208313
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:13:59] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341394
[11/24/2022-12:13:59] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0208313
[11/24/2022-12:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:13:59] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0157664
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0162072
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0177813
[11/24/2022-12:13:59] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0157664
[11/24/2022-12:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:13:59] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0189103
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:13:59] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0200863
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0244137
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0322981
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:13:59] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0301659
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:13:59] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0195994
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:13:59] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0405337
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:13:59] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0266255
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:13:59] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0255726
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0298048
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0319808
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0238126
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0323822
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:13:59] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0199223
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0236761
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0296933
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0305509
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0242994
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0237851
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0233502
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0237838
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:13:59] [V] [TRT] Tactic: -621838502160440068 Time: 0.02504
[11/24/2022-12:13:59] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0189103
[11/24/2022-12:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_751 (CaskConvolution)
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:13:59] [V] [TRT] Tactic: 424230345342282109 Time: 0.0204702
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:13:59] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0311186
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:13:59] [V] [TRT] Tactic: 2881044142075831475 Time: 0.017928
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0340562
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0234286
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:13:59] [V] [TRT] Tactic: 7107586691882206281 Time: 0.026
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:13:59] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0305307
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:13:59] [V] [TRT] Tactic: 7507411019787288861 Time: 0.015227
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:13:59] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0341138
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:13:59] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0260762
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:13:59] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0234155
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:13:59] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0204558
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:13:59] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0203434
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0183417
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:13:59] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0149957
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0179537
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0292635
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:13:59] [V] [TRT] Tactic: -3514726588976755320 Time: 0.042328
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:13:59] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0152827
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0334665
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:13:59] [V] [TRT] Tactic: -1008204680238783384 Time: 0.019916
[11/24/2022-12:13:59] [V] [TRT] node_of_751 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:13:59] [V] [TRT] Tactic: -50323486981480818 Time: 0.0186377
[11/24/2022-12:13:59] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0149957
[11/24/2022-12:13:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:13:59] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:13:59] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_754 (CudaDepthwiseConvolution)
[11/24/2022-12:13:59] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:13:59] [V] [TRT] --------------- Timing Runner: node_of_754 (FusedConvActConvolution)
[11/24/2022-12:13:59] [V] [TRT] Tactic: 589823 Time: 0.0791794
[11/24/2022-12:13:59] [V] [TRT] Tactic: 786431 Time: 0.0532267
[11/24/2022-12:13:59] [V] [TRT] Tactic: 1179647 Time: 0.094
[11/24/2022-12:13:59] [V] [TRT] Tactic: 1638399 Time: 0.0596587
[11/24/2022-12:13:59] [V] [TRT] Tactic: 2097151 Time: 0.069667
[11/24/2022-12:13:59] [V] [TRT] Tactic: 3538943 Time: 0.082928
[11/24/2022-12:13:59] [V] [TRT] Tactic: 3997695 Time: 0.0560229
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4194303 Time: 0.0505737
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4259839 Time: 0.064611
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4587519 Time: 0.0525669
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4653055 Time: 0.0979817
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4915199 Time: 0.0564434
[11/24/2022-12:13:59] [V] [TRT] Tactic: 4980735 Time: 0.0480488
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5177343 Time: 0.0958446
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5242879 Time: 0.0665935
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5373951 Time: 0.108281
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5767167 Time: 0.186286
[11/24/2022-12:13:59] [V] [TRT] Tactic: 5898239 Time: 0.0946651
[11/24/2022-12:13:59] [V] [TRT] Tactic: 6225919 Time: 0.0740754
[11/24/2022-12:13:59] [V] [TRT] Tactic: 6291455 Time: 0.0956686
[11/24/2022-12:13:59] [V] [TRT] Tactic: 6815743 Time: 0.0848091
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7012351 Time: 0.0696122
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7077887 Time: 0.07416
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7143423 Time: 0.0869531
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7208959 Time: 0.0690042
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7340031 Time: 0.102313
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7536639 Time: 0.107792
[11/24/2022-12:14:00] [V] [TRT] Tactic: 7733247 Time: 0.0800137
[11/24/2022-12:14:00] [V] [TRT] Tactic: 8191999 Time: 0.061408
[11/24/2022-12:14:00] [V] [TRT] Tactic: 8716287 Time: 0.106939
[11/24/2022-12:14:00] [V] [TRT] Tactic: 9109503 Time: 0.0727291
[11/24/2022-12:14:00] [V] [TRT] Tactic: 9568255 Time: 0.0572069
[11/24/2022-12:14:00] [V] [TRT] Tactic: 10354687 Time: 0.0617493
[11/24/2022-12:14:00] [V] [TRT] Tactic: 10747903 Time: 0.0768389
[11/24/2022-12:14:00] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0480488
[11/24/2022-12:14:00] [V] [TRT] --------------- Timing Runner: node_of_754 (CudnnConvolution)
[11/24/2022-12:14:00] [V] [TRT] Tactic: 0 Time: 0.0490514
[11/24/2022-12:14:00] [V] [TRT] Tactic: 1 Time: 0.0483246
[11/24/2022-12:14:00] [V] [TRT] Tactic: 2 Time: 0.0718126
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4 Time: 3.80469
[11/24/2022-12:14:00] [V] [TRT] Tactic: 5 Time: 0.263694
[11/24/2022-12:14:00] [V] [TRT] Tactic: 56 Time: 0.0491672
[11/24/2022-12:14:00] [V] [TRT] Tactic: 57 Time: 0.0499627
[11/24/2022-12:14:00] [V] [TRT] Tactic: 58 Time: 0.0723497
[11/24/2022-12:14:00] [V] [TRT] Tactic: 60 Time: 3.6724
[11/24/2022-12:14:00] [V] [TRT] Tactic: 61 Time: 0.261925
[11/24/2022-12:14:00] [V] [TRT] Tactic: 112 Time: 0.049603
[11/24/2022-12:14:00] [V] [TRT] Tactic: 113 Time: 0.0505737
[11/24/2022-12:14:00] [V] [TRT] Tactic: 114 Time: 0.0703299
[11/24/2022-12:14:00] [V] [TRT] Tactic: 116 Time: 3.71059
[11/24/2022-12:14:00] [V] [TRT] Tactic: 117 Time: 0.261175
[11/24/2022-12:14:00] [V] [TRT] Fastest Tactic: 1 Time: 0.0483246
[11/24/2022-12:14:00] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:00] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:00] [V] [TRT] Tactic: 621442388677115936 Time: 0.148041
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:00] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0748846
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:00] [V] [TRT] Tactic: 3377996665278764661 Time: 0.288699
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0856389
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0648107
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4918658762935651592 Time: 0.143223
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:00] [V] [TRT] Tactic: 5779835512569528575 Time: 0.117221
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:00] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0997417
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:00] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0694354
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:00] [V] [TRT] Tactic: 8048119769507926928 Time: 0.14544
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:00] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0810697
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:00] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0797326
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:00] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0373223
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:00] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0430709
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:00] [V] [TRT] Tactic: -6273689210331812572 Time: 0.115387
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:00] [V] [TRT] Tactic: -4562045946847239058 Time: 0.148539
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:00] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0616183
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:00] [V] [TRT] Tactic: -2777237991111865351 Time: 0.157961
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:00] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0866537
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:00] [V] [TRT] Tactic: -1349585930542925704 Time: 0.103333
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:00] [V] [TRT] Tactic: -1123676555321336786 Time: 0.120553
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:00] [V] [TRT] Tactic: -701551393537224327 Time: 0.0714651
[11/24/2022-12:14:00] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0373223
[11/24/2022-12:14:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:00] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(473088,1,5376,32) ***************
[11/24/2022-12:14:00] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:00] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:00] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:00] [V] [TRT] Tactic: 1162498931361159915 Time: 0.12347
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:14:00] [V] [TRT] Tactic: 1663866669559596164 Time: 0.107952
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:14:00] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0769234
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:00] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0779154
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0622888
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0627672
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:14:00] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0770034
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:14:00] [V] [TRT] Tactic: 5778138195697110003 Time: 0.10867
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:00] [V] [TRT] Tactic: 6185707384100198445 Time: 0.072528
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:14:00] [V] [TRT] Tactic: 8918020581761223752 Time: 0.1072
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:14:00] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0739086
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:14:00] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0599192
[11/24/2022-12:14:00] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:14:01] [V] [TRT] Tactic: -2809379259463049391 Time: 0.109273
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:14:01] [V] [TRT] Tactic: -1985235291706575900 Time: 0.10584
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:14:01] [V] [TRT] Tactic: -504296718212024303 Time: 0.107511
[11/24/2022-12:14:01] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0599192
[11/24/2022-12:14:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:14:01] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(118272,1:4,1344,8) ***************
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0599771
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2536540085349545921 Time: 0.061667
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0694598
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0817989
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:01] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0611459
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:01] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0690743
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:01] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0678537
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:01] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0940549
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:01] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0625051
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:01] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0577981
[11/24/2022-12:14:01] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0577981
[11/24/2022-12:14:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:01] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CudnnConvolution)
[11/24/2022-12:14:01] [V] [TRT] Tactic: 0 Time: 0.0493501
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1 Time: 0.0496472
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2 Time: 0.0703451
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4 Time: 3.90453
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5 Time: 0.172219
[11/24/2022-12:14:01] [V] [TRT] Tactic: 56 Time: 0.048803
[11/24/2022-12:14:01] [V] [TRT] Tactic: 58 Time: 0.0704975
[11/24/2022-12:14:01] [V] [TRT] Tactic: 60 Time: 3.69076
[11/24/2022-12:14:01] [V] [TRT] Tactic: 61 Time: 0.175771
[11/24/2022-12:14:01] [V] [TRT] Fastest Tactic: 56 Time: 0.048803
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:14:01] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784:2,168,1) ***************
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (FusedConvActConvolution)
[11/24/2022-12:14:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0272632
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:01] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0944526
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0419463
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0417646
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0405509
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:01] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0260259
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0707352
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0261394
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:01] [V] [TRT] Tactic: -1546027692247304867 Time: 0.093808
[11/24/2022-12:14:01] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0260259
[11/24/2022-12:14:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:01] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:01] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(59136,1:8,672,4) ***************
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CudaDepthwiseConvolution)
[11/24/2022-12:14:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:01] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:01] [V] [TRT] Tactic: 254850674756030979 Time: 0.0341019
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0343168
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0262156
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0340946
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0206576
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0756023
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0413269
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0287214
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:01] [V] [TRT] Tactic: 1899296423087490472 Time: 0.045064
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0466743
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0295671
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0531855
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0673448
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:01] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0288567
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:01] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0219997
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:01] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0153783
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:01] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0477775
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:01] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0349403
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:01] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0340562
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4278315135102886928 Time: 0.063613
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0207504
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0292946
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0342693
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:01] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0289417
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0339913
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0342565
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0287497
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5346855796032465921 Time: 0.039864
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:01] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0307621
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0396663
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0340279
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0474457
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0464743
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0719589
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:01] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0398514
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:01] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0209378
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:01] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0263383
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:01] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0265006
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:01] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0451269
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:01] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0449417
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:01] [V] [TRT] Tactic: 8764780417487154889 Time: 0.030709
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:01] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0206518
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:01] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0300334
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:01] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0613745
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:01] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0327067
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:01] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0312091
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:01] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0230198
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:01] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0641173
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:01] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0315127
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:01] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0542766
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:01] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0724663
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:01] [V] [TRT] Tactic: -6063766379489217211 Time: 0.03976
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:01] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0287973
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:01] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0150702
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:01] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0288101
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:01] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0478766
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:01] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0402571
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:01] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0367737
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4950923835688973492 Time: 0.02624
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0779794
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0425349
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0260754
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0376331
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0344055
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:01] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0653684
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:01] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0804914
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:01] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0316745
[11/24/2022-12:14:01] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:01] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0206243
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0206968
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0397486
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0478811
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0180251
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0451509
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288192
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0424183
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0379794
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208797
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0267345
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0287013
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0612404
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0563977
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0369246
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:02] [V] [TRT] Tactic: -406984317033388136 Time: 0.0316645
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:02] [V] [TRT] Tactic: -331499326992534460 Time: 0.0259291
[11/24/2022-12:14:02] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0150702
[11/24/2022-12:14:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CublasConvolution)
[11/24/2022-12:14:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:02] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CudaDepthwiseConvolution)
[11/24/2022-12:14:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:02] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0614629
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:02] [V] [TRT] Tactic: 2141154648944475104 Time: 0.061245
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:02] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0616762
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259787
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342766
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:02] [V] [TRT] Tactic: -6580271968881459581 Time: 0.021026
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:02] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0342647
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:02] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0258705
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0209352
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0261623
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:02] [V] [TRT] Tactic: -108011214168778087 Time: 0.0207915
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:02] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341769
[11/24/2022-12:14:02] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0207915
[11/24/2022-12:14:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:02] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0161549
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0166608
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:02] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0179194
[11/24/2022-12:14:02] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0161549
[11/24/2022-12:14:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:14:02] [V] [TRT] Tactic: 2818014835119698671 Time: 0.018868
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:14:02] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0204212
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0243825
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0325952
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:14:02] [V] [TRT] Tactic: 6556170942941957134 Time: 0.030539
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:14:02] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0196246
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:14:02] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0401051
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:14:02] [V] [TRT] Tactic: -8912999970161746151 Time: 0.026563
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:14:02] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0259817
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:14:02] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0305792
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:14:02] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0325111
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:14:02] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0242316
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:14:02] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0327963
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:14:02] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0199817
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:14:02] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0242598
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:14:02] [V] [TRT] Tactic: -5416590980288859834 Time: 0.029856
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0308873
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0244533
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0239924
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0233437
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0242149
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:14:02] [V] [TRT] Tactic: -621838502160440068 Time: 0.0254903
[11/24/2022-12:14:02] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.018868
[11/24/2022-12:14:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_754 (CaskConvolution)
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:14:02] [V] [TRT] Tactic: 424230345342282109 Time: 0.0207347
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:14:02] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0313326
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:14:02] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0179914
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4549109251242445288 Time: 0.034389
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0237264
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0263352
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0314715
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0154693
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0344466
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0264411
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:14:02] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0237473
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:14:02] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0207256
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:14:02] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0204924
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:14:02] [V] [TRT] Tactic: -5817829912551792981 Time: 0.018664
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:14:02] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0151287
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0180623
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0293705
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:14:02] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0422994
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:14:02] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0153778
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0338304
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:14:02] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0192869
[11/24/2022-12:14:02] [V] [TRT] node_of_754 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:14:02] [V] [TRT] Tactic: -50323486981480818 Time: 0.0189314
[11/24/2022-12:14:02] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0151287
[11/24/2022-12:14:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:14:02] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(473088,1,5376,32) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(118272,1:4,1344,8) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784:2,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(59136,1:8,672,4) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(473088,1,5376,32) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(118272,1:4,1344,8) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784:2,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(59136,1:8,672,4) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(473088,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:02] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_763 (CudaDepthwiseConvolution)
[11/24/2022-12:14:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:02] [V] [TRT] --------------- Timing Runner: node_of_763 (FusedConvActConvolution)
[11/24/2022-12:14:02] [V] [TRT] Tactic: 589823 Time: 0.0773783
[11/24/2022-12:14:02] [V] [TRT] Tactic: 786431 Time: 0.0541775
[11/24/2022-12:14:02] [V] [TRT] Tactic: 1179647 Time: 0.0930286
[11/24/2022-12:14:02] [V] [TRT] Tactic: 1638399 Time: 0.0599863
[11/24/2022-12:14:02] [V] [TRT] Tactic: 2097151 Time: 0.0694095
[11/24/2022-12:14:02] [V] [TRT] Tactic: 3538943 Time: 0.0807291
[11/24/2022-12:14:02] [V] [TRT] Tactic: 3997695 Time: 0.0572937
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4194303 Time: 0.0498971
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4259839 Time: 0.0644282
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4587519 Time: 0.0503269
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4653055 Time: 0.0975177
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4915199 Time: 0.0585691
[11/24/2022-12:14:02] [V] [TRT] Tactic: 4980735 Time: 0.0491429
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5177343 Time: 0.0946857
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5242879 Time: 0.0677196
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5373951 Time: 0.107913
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5767167 Time: 0.189906
[11/24/2022-12:14:02] [V] [TRT] Tactic: 5898239 Time: 0.0935954
[11/24/2022-12:14:02] [V] [TRT] Tactic: 6225919 Time: 0.0728411
[11/24/2022-12:14:02] [V] [TRT] Tactic: 6291455 Time: 0.095376
[11/24/2022-12:14:02] [V] [TRT] Tactic: 6815743 Time: 0.0847543
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7012351 Time: 0.0694888
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7077887 Time: 0.0760114
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7143423 Time: 0.0854926
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7208959 Time: 0.0691383
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7340031 Time: 0.107159
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7536639 Time: 0.109467
[11/24/2022-12:14:02] [V] [TRT] Tactic: 7733247 Time: 0.08008
[11/24/2022-12:14:02] [V] [TRT] Tactic: 8191999 Time: 0.0617006
[11/24/2022-12:14:02] [V] [TRT] Tactic: 8716287 Time: 0.10768
[11/24/2022-12:14:02] [V] [TRT] Tactic: 9109503 Time: 0.0731657
[11/24/2022-12:14:03] [V] [TRT] Tactic: 9568255 Time: 0.0611886
[11/24/2022-12:14:03] [V] [TRT] Tactic: 10354687 Time: 0.0628389
[11/24/2022-12:14:03] [V] [TRT] Tactic: 10747903 Time: 0.0750903
[11/24/2022-12:14:03] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0491429
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CudnnConvolution)
[11/24/2022-12:14:03] [V] [TRT] Tactic: 0 Time: 0.049411
[11/24/2022-12:14:03] [V] [TRT] Tactic: 1 Time: 0.0496411
[11/24/2022-12:14:03] [V] [TRT] Tactic: 2 Time: 0.071488
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4 Time: 3.80783
[11/24/2022-12:14:03] [V] [TRT] Tactic: 5 Time: 0.259685
[11/24/2022-12:14:03] [V] [TRT] Tactic: 56 Time: 0.0488869
[11/24/2022-12:14:03] [V] [TRT] Tactic: 57 Time: 0.0490789
[11/24/2022-12:14:03] [V] [TRT] Tactic: 58 Time: 0.0707596
[11/24/2022-12:14:03] [V] [TRT] Tactic: 60 Time: 3.66391
[11/24/2022-12:14:03] [V] [TRT] Tactic: 61 Time: 0.261198
[11/24/2022-12:14:03] [V] [TRT] Tactic: 112 Time: 0.0485547
[11/24/2022-12:14:03] [V] [TRT] Tactic: 113 Time: 0.0505295
[11/24/2022-12:14:03] [V] [TRT] Tactic: 114 Time: 0.0708724
[11/24/2022-12:14:03] [V] [TRT] Tactic: 116 Time: 3.79448
[11/24/2022-12:14:03] [V] [TRT] Tactic: 117 Time: 0.261435
[11/24/2022-12:14:03] [V] [TRT] Fastest Tactic: 112 Time: 0.0485547
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:03] [V] [TRT] Tactic: 621442388677115936 Time: 0.148773
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:03] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0731131
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:03] [V] [TRT] Tactic: 3377996665278764661 Time: 0.289714
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0858629
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4549827808004681195 Time: 0.064483
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4918658762935651592 Time: 0.142165
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:03] [V] [TRT] Tactic: 5779835512569528575 Time: 0.114585
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:03] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0997966
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:03] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0685211
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:03] [V] [TRT] Tactic: 8048119769507926928 Time: 0.145723
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:03] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0816251
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:03] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0794423
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:03] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0373577
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:03] [V] [TRT] Tactic: -6313876406580483184 Time: 0.042448
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:03] [V] [TRT] Tactic: -6273689210331812572 Time: 0.113168
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:03] [V] [TRT] Tactic: -4562045946847239058 Time: 0.147209
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:03] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0624686
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:03] [V] [TRT] Tactic: -2777237991111865351 Time: 0.156681
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:03] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0846149
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:03] [V] [TRT] Tactic: -1349585930542925704 Time: 0.103545
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:03] [V] [TRT] Tactic: -1123676555321336786 Time: 0.117913
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:03] [V] [TRT] Tactic: -701551393537224327 Time: 0.0669714
[11/24/2022-12:14:03] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0373577
[11/24/2022-12:14:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:03] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:03] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122185
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:14:03] [V] [TRT] Tactic: 1663866669559596164 Time: 0.107346
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:14:03] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0771863
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:03] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0761349
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0626179
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0626651
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:14:03] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0776366
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:14:03] [V] [TRT] Tactic: 5778138195697110003 Time: 0.10888
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:03] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0720274
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:14:03] [V] [TRT] Tactic: 8918020581761223752 Time: 0.107195
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:14:03] [V] [TRT] Tactic: -5905193483742532701 Time: 0.074848
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:14:03] [V] [TRT] Tactic: -4035591156787122265 Time: 0.060448
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:14:03] [V] [TRT] Tactic: -2809379259463049391 Time: 0.110731
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:14:03] [V] [TRT] Tactic: -1985235291706575900 Time: 0.106466
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:14:03] [V] [TRT] Tactic: -504296718212024303 Time: 0.108174
[11/24/2022-12:14:03] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.060448
[11/24/2022-12:14:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:14:03] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:03] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:03] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:03] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0591741
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:03] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0588876
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:03] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0703543
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:03] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0825714
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:03] [V] [TRT] Tactic: 7058864664858220889 Time: 0.059357
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:03] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0698011
[11/24/2022-12:14:03] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:03] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0665996
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0943749
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0648137
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0581806
[11/24/2022-12:14:04] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0581806
[11/24/2022-12:14:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CudnnConvolution)
[11/24/2022-12:14:04] [V] [TRT] Tactic: 0 Time: 0.0488823
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1 Time: 0.0494339
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2 Time: 0.0705569
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4 Time: 3.74088
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5 Time: 0.17195
[11/24/2022-12:14:04] [V] [TRT] Tactic: 56 Time: 0.0491413
[11/24/2022-12:14:04] [V] [TRT] Tactic: 58 Time: 0.0705006
[11/24/2022-12:14:04] [V] [TRT] Tactic: 60 Time: 3.63852
[11/24/2022-12:14:04] [V] [TRT] Tactic: 61 Time: 0.171031
[11/24/2022-12:14:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0488823
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (FusedConvActConvolution)
[11/24/2022-12:14:04] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0276213
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:04] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0945303
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0419211
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0418789
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0404937
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:04] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0260168
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0717669
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0260792
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0947749
[11/24/2022-12:14:04] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0260168
[11/24/2022-12:14:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CudaDepthwiseConvolution)
[11/24/2022-12:14:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:04] [V] [TRT] Tactic: 254850674756030979 Time: 0.0341358
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0345984
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0262644
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0342446
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0205969
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0757303
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1832046141070096030 Time: 0.041264
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0286784
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0447954
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0461006
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2541579301352125276 Time: 0.029195
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0532709
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0667581
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:04] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0287909
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:04] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0212291
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:04] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0152987
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:04] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0477455
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:04] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0350811
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:04] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0340718
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0636297
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0206746
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0292453
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0343387
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:04] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0289865
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0340782
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0343552
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0287525
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0398743
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:04] [V] [TRT] Tactic: 5398999388616959893 Time: 0.031051
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6034364043891107501 Time: 0.039616
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0341275
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0476328
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0468537
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0723269
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:04] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0397383
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:04] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0208281
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:04] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0261562
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:04] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0264701
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:04] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0449851
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:04] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0448617
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:04] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0303177
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:04] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0208013
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:04] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0295936
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:04] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0612861
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:04] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0328457
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:04] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0314359
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:04] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0232059
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:04] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0645135
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:04] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0314085
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:04] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0541791
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:04] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0722423
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:04] [V] [TRT] Tactic: -6063766379489217211 Time: 0.039608
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:04] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0288165
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:04] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0150729
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:04] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0287287
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:04] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0478156
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:04] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0398606
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:04] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0359086
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0261379
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0774331
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4548822885169694805 Time: 0.04244
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0260442
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371909
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0342181
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:04] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0646385
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:04] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0801531
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:04] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314633
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:04] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0204057
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:04] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0206857
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:04] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0396126
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:04] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476312
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:04] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0181314
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:04] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0451531
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:04] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0290167
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:04] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0422971
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:04] [V] [TRT] Tactic: -2003055242756584050 Time: 0.038456
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208313
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0266781
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0287095
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0610728
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0571794
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:04] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0371703
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:04] [V] [TRT] Tactic: -406984317033388136 Time: 0.0316699
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:04] [V] [TRT] Tactic: -331499326992534460 Time: 0.0261029
[11/24/2022-12:14:04] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0150729
[11/24/2022-12:14:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CublasConvolution)
[11/24/2022-12:14:04] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CudaDepthwiseConvolution)
[11/24/2022-12:14:04] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:04] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:04] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0618758
[11/24/2022-12:14:04] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:05] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0615802
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:05] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0626971
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259771
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342117
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:05] [V] [TRT] Tactic: -6580271968881459581 Time: 0.020866
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:05] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0343296
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:05] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0258347
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:05] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0211109
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:05] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0261844
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:05] [V] [TRT] Tactic: -108011214168778087 Time: 0.0210031
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:05] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341486
[11/24/2022-12:14:05] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.020866
[11/24/2022-12:14:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:14:05] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:05] [V] [TRT] --------------- Timing Runner: node_of_763 (CaskConvolution)
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:05] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0157326
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0164292
[11/24/2022-12:14:05] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:05] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0178337
[11/24/2022-12:14:05] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0157326
[11/24/2022-12:14:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:05] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:05] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:05] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:05] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:05] [V] [TRT] --------------- Timing Runner: node_of_766 (CudaDepthwiseConvolution)
[11/24/2022-12:14:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:05] [V] [TRT] --------------- Timing Runner: node_of_766 (FusedConvActConvolution)
[11/24/2022-12:14:05] [V] [TRT] Tactic: 589823 Time: 0.13451
[11/24/2022-12:14:05] [V] [TRT] Tactic: 655359 Time: 0.136811
[11/24/2022-12:14:05] [V] [TRT] Tactic: 786431 Time: 0.0676891
[11/24/2022-12:14:05] [V] [TRT] Tactic: 851967 Time: 0.197842
[11/24/2022-12:14:05] [V] [TRT] Tactic: 1179647 Time: 0.121447
[11/24/2022-12:14:05] [V] [TRT] Tactic: 1638399 Time: 0.0751314
[11/24/2022-12:14:05] [V] [TRT] Tactic: 2097151 Time: 0.0885417
[11/24/2022-12:14:05] [V] [TRT] Tactic: 3538943 Time: 0.109424
[11/24/2022-12:14:05] [V] [TRT] Tactic: 3932159 Time: 0.145202
[11/24/2022-12:14:05] [V] [TRT] Tactic: 3997695 Time: 0.0693059
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4194303 Time: 0.0662248
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4259839 Time: 0.0810903
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4587519 Time: 0.0614065
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4653055 Time: 0.120135
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4915199 Time: 0.0746149
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4980735 Time: 0.0659413
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5177343 Time: 0.118846
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5242879 Time: 0.0892891
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5373951 Time: 0.133673
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5570559 Time: 0.175259
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5767167 Time: 0.207488
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5898239 Time: 0.121703
[11/24/2022-12:14:05] [V] [TRT] Tactic: 6225919 Time: 0.0900914
[11/24/2022-12:14:05] [V] [TRT] Tactic: 6291455 Time: 0.11736
[11/24/2022-12:14:05] [V] [TRT] Tactic: 6815743 Time: 0.104505
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7012351 Time: 0.0883817
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7077887 Time: 0.0922514
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7143423 Time: 0.143232
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7208959 Time: 0.0928
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7340031 Time: 0.129781
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7536639 Time: 0.199081
[11/24/2022-12:14:05] [V] [TRT] Tactic: 7733247 Time: 0.102039
[11/24/2022-12:14:05] [V] [TRT] Tactic: 8191999 Time: 0.0818583
[11/24/2022-12:14:05] [V] [TRT] Tactic: 8716287 Time: 0.119079
[11/24/2022-12:14:05] [V] [TRT] Tactic: 9109503 Time: 0.0920091
[11/24/2022-12:14:05] [V] [TRT] Tactic: 9568255 Time: 0.0744777
[11/24/2022-12:14:05] [V] [TRT] Tactic: 10354687 Time: 0.0736663
[11/24/2022-12:14:05] [V] [TRT] Tactic: 10747903 Time: 0.09456
[11/24/2022-12:14:05] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0614065
[11/24/2022-12:14:05] [V] [TRT] --------------- Timing Runner: node_of_766 (CudnnConvolution)
[11/24/2022-12:14:05] [V] [TRT] Tactic: 0 Time: 0.056576
[11/24/2022-12:14:05] [V] [TRT] Tactic: 1 Time: 0.0552914
[11/24/2022-12:14:05] [V] [TRT] Tactic: 2 Time: 0.264512
[11/24/2022-12:14:05] [V] [TRT] Tactic: 4 Time: 10.8547
[11/24/2022-12:14:05] [V] [TRT] Tactic: 5 Time: 0.277632
[11/24/2022-12:14:05] [V] [TRT] Tactic: 56 Time: 0.0555581
[11/24/2022-12:14:05] [V] [TRT] Tactic: 57 Time: 0.0562164
[11/24/2022-12:14:05] [V] [TRT] Tactic: 58 Time: 0.257294
[11/24/2022-12:14:06] [V] [TRT] Tactic: 60 Time: 10.7585
[11/24/2022-12:14:06] [V] [TRT] Tactic: 61 Time: 0.275767
[11/24/2022-12:14:06] [V] [TRT] Tactic: 112 Time: 0.0548145
[11/24/2022-12:14:06] [V] [TRT] Tactic: 113 Time: 0.0566644
[11/24/2022-12:14:06] [V] [TRT] Tactic: 114 Time: 0.257294
[11/24/2022-12:14:06] [V] [TRT] Tactic: 116 Time: 10.6925
[11/24/2022-12:14:06] [V] [TRT] Tactic: 117 Time: 0.237883
[11/24/2022-12:14:06] [V] [TRT] Fastest Tactic: 112 Time: 0.0548145
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:06] [V] [TRT] Tactic: 621442388677115936 Time: 0.150976
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:06] [V] [TRT] Tactic: 1327459216264546184 Time: 0.079792
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:06] [V] [TRT] Tactic: 3377996665278764661 Time: 0.289906
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:06] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0857737
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:06] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0665402
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:06] [V] [TRT] Tactic: 4918658762935651592 Time: 0.140453
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:06] [V] [TRT] Tactic: 5779835512569528575 Time: 0.115808
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:06] [V] [TRT] Tactic: 5837905844602864231 Time: 0.103143
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:06] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0714971
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:06] [V] [TRT] Tactic: 8048119769507926928 Time: 0.149806
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:06] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0819954
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:06] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0791612
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:06] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0407611
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:06] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0432994
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:06] [V] [TRT] Tactic: -6273689210331812572 Time: 0.117397
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:06] [V] [TRT] Tactic: -4562045946847239058 Time: 0.156553
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:06] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0647147
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:06] [V] [TRT] Tactic: -2777237991111865351 Time: 0.16091
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0875589
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1349585930542925704 Time: 0.111554
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1123676555321336786 Time: 0.120089
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:06] [V] [TRT] Tactic: -701551393537224327 Time: 0.0711771
[11/24/2022-12:14:06] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0407611
[11/24/2022-12:14:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:06] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:06] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122245
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:14:06] [V] [TRT] Tactic: 1663866669559596164 Time: 0.107911
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:14:06] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0793211
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:06] [V] [TRT] Tactic: 3887292144336338310 Time: 0.077504
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:14:06] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0659718
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:14:06] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0652312
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:14:06] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0805783
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:14:06] [V] [TRT] Tactic: 5778138195697110003 Time: 0.110414
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:06] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0745371
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:14:06] [V] [TRT] Tactic: 8918020581761223752 Time: 0.109035
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:14:06] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0784046
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:14:06] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0617036
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:14:06] [V] [TRT] Tactic: -2809379259463049391 Time: 0.110802
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1985235291706575900 Time: 0.105904
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:14:06] [V] [TRT] Tactic: -504296718212024303 Time: 0.107913
[11/24/2022-12:14:06] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0617036
[11/24/2022-12:14:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:14:06] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:06] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0570621
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:06] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0587871
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:06] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0687055
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:06] [V] [TRT] Tactic: 6832381412128253616 Time: 0.081392
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:06] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0591421
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:06] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0696274
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:06] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0661486
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0937806
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1366318165940453381 Time: 0.064579
[11/24/2022-12:14:06] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:06] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0573882
[11/24/2022-12:14:06] [V] [TRT] Fastest Tactic: 1373022415249282411 Time: 0.0570621
[11/24/2022-12:14:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1373022415249282411
[11/24/2022-12:14:06] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:06] [V] [TRT] --------------- Timing Runner: node_of_766 (CudnnConvolution)
[11/24/2022-12:14:06] [V] [TRT] Tactic: 0 Time: 0.0523215
[11/24/2022-12:14:06] [V] [TRT] Tactic: 1 Time: 0.0524389
[11/24/2022-12:14:06] [V] [TRT] Tactic: 2 Time: 0.248169
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4 Time: 10.984
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5 Time: 0.167822
[11/24/2022-12:14:07] [V] [TRT] Tactic: 56 Time: 0.0502872
[11/24/2022-12:14:07] [V] [TRT] Tactic: 58 Time: 0.244119
[11/24/2022-12:14:07] [V] [TRT] Tactic: 60 Time: 9.23068
[11/24/2022-12:14:07] [V] [TRT] Tactic: 61 Time: 0.182103
[11/24/2022-12:14:07] [V] [TRT] Fastest Tactic: 56 Time: 0.0502872
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:14:07] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (FusedConvActConvolution)
[11/24/2022-12:14:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:07] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0265326
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:07] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0936
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4418200634486186714 Time: 0.040984
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0408171
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0391726
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:07] [V] [TRT] Tactic: 7392644644614664811 Time: 0.024416
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0699749
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0258065
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0937989
[11/24/2022-12:14:07] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.024416
[11/24/2022-12:14:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:07] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:07] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CudaDepthwiseConvolution)
[11/24/2022-12:14:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:07] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:07] [V] [TRT] Tactic: 254850674756030979 Time: 0.0327698
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0343397
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0257699
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0328439
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0196126
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0748091
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1832046141070096030 Time: 0.039976
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1838082074606840426 Time: 0.02672
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:07] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0431829
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:07] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0455646
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:07] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0286345
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:07] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0530926
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:07] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0662491
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:07] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0278712
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:07] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0205231
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:07] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0143493
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:07] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0470709
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:07] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0349678
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:07] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0326958
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4278315135102886928 Time: 0.061955
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0203103
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0286528
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0335049
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:07] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0287342
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0328091
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0331273
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0275771
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0395337
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:07] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0291218
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0392411
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0328402
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0455977
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0455886
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0707032
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:07] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0391577
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:07] [V] [TRT] Tactic: 7216571380637776659 Time: 0.020879
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:07] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0261143
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:07] [V] [TRT] Tactic: 8095507026323593899 Time: 0.026653
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:07] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0449177
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:07] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0450926
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:07] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0303991
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:07] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207066
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:07] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0301934
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:07] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0612632
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:07] [V] [TRT] Tactic: -8280443484414412687 Time: 0.033579
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:07] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0314661
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:07] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0230021
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:07] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0647482
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:07] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0314633
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:07] [V] [TRT] Tactic: -7089118800560870395 Time: 0.054176
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:07] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0718766
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:07] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0396766
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:07] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0288832
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:07] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0150363
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:07] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0288
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:07] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0477623
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:07] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0399314
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:07] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0361177
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0260411
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0772457
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0424926
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0260061
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0373063
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0342821
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:07] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0648701
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:07] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0804411
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:07] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0313746
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:07] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0203143
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:07] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207301
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:07] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0395017
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:07] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0475726
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:07] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0181291
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:07] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0450046
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:07] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288923
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:07] [V] [TRT] Tactic: -2032577876140256150 Time: 0.042512
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:07] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0381234
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208202
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0268411
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0286263
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0614263
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0573394
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:07] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0370651
[11/24/2022-12:14:07] [V] [TRT] node_of_766 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:07] [V] [TRT] Tactic: -406984317033388136 Time: 0.0318418
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:08] [V] [TRT] Tactic: -331499326992534460 Time: 0.0258903
[11/24/2022-12:14:08] [V] [TRT] Fastest Tactic: 3359475309458902373 Time: 0.0143493
[11/24/2022-12:14:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3359475309458902373
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CublasConvolution)
[11/24/2022-12:14:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:08] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CudaDepthwiseConvolution)
[11/24/2022-12:14:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:08] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0619246
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:08] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0612724
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:08] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0626651
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0260084
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0341358
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:08] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0207673
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:08] [V] [TRT] Tactic: -5576936487443445631 Time: 0.034347
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:08] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0259078
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:08] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0213923
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:08] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0262141
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:08] [V] [TRT] Tactic: -108011214168778087 Time: 0.0208562
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:08] [V] [TRT] Tactic: -42427192380281294 Time: 0.0342391
[11/24/2022-12:14:08] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0207673
[11/24/2022-12:14:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:08] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0168838
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0172185
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:08] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0179023
[11/24/2022-12:14:08] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0168838
[11/24/2022-12:14:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:14:08] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0189486
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:14:08] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0204487
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0243116
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5012796702462679112 Time: 0.032501
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:14:08] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0302802
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:14:08] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0193743
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:14:08] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0402754
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:14:08] [V] [TRT] Tactic: -8912999970161746151 Time: 0.026099
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:14:08] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0258667
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:14:08] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0301595
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:14:08] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0318299
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:14:08] [V] [TRT] Tactic: -7606074703023778034 Time: 0.024061
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:14:08] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0322834
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:14:08] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0201943
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:14:08] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0242507
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:14:08] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0294583
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:14:08] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0302939
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:14:08] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0245333
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:14:08] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0240137
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:14:08] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0234599
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:14:08] [V] [TRT] Tactic: -1610768292520086910 Time: 0.023616
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:14:08] [V] [TRT] Tactic: -621838502160440068 Time: 0.0252884
[11/24/2022-12:14:08] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0189486
[11/24/2022-12:14:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_766 (CaskConvolution)
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:14:08] [V] [TRT] Tactic: 424230345342282109 Time: 0.020832
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:14:08] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0311387
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:14:08] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0179966
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0342903
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5730376045873629665 Time: 0.023409
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7107586691882206281 Time: 0.026144
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0299803
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0154478
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0343278
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0262857
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:14:08] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0234952
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:14:08] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0204082
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:14:08] [V] [TRT] Tactic: -6733478368603461850 Time: 0.020414
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:14:08] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0184714
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:14:08] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0152731
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:14:08] [V] [TRT] Tactic: -3773982102975252832 Time: 0.017988
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:14:08] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0293294
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:14:08] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0424709
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:14:08] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0155803
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:14:08] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0335269
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:14:08] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0204194
[11/24/2022-12:14:08] [V] [TRT] node_of_766 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:14:08] [V] [TRT] Tactic: -50323486981480818 Time: 0.0187766
[11/24/2022-12:14:08] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0152731
[11/24/2022-12:14:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:14:08] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(354816,14784,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(354816,1,4032,24) -> Float(7569408,1,86016,512) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(88704,1:4,1008,6) -> Float(1892352,1:4,21504,128) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(354816,14784,168,1) -> Half(7569408,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(177408,14784:2,168,1) -> Half(3784704,14784:2,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(44352,1:8,504,3) -> Half(946176,1:8,10752,64) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(29568,1:16,336,2) -> Half(473088,1:16,5376,32) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(1892352,14784:4,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(88704,14784:4,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(7569408,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Float(236544,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Half(236544,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Int8(14784,14784:32,168,1) -> Int8(236544,14784:32,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:08] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_772 (CudaDepthwiseConvolution)
[11/24/2022-12:14:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:08] [V] [TRT] --------------- Timing Runner: node_of_772 (FusedConvActConvolution)
[11/24/2022-12:14:08] [V] [TRT] Tactic: 589823 Time: 0.116649
[11/24/2022-12:14:08] [V] [TRT] Tactic: 655359 Time: 0.157152
[11/24/2022-12:14:08] [V] [TRT] Tactic: 786431 Time: 0.059491
[11/24/2022-12:14:08] [V] [TRT] Tactic: 851967 Time: 0.230619
[11/24/2022-12:14:08] [V] [TRT] Tactic: 1179647 Time: 0.120199
[11/24/2022-12:14:08] [V] [TRT] Tactic: 1638399 Time: 0.0788617
[11/24/2022-12:14:08] [V] [TRT] Tactic: 2097151 Time: 0.0840229
[11/24/2022-12:14:08] [V] [TRT] Tactic: 3538943 Time: 0.112935
[11/24/2022-12:14:08] [V] [TRT] Tactic: 3932159 Time: 0.134002
[11/24/2022-12:14:08] [V] [TRT] Tactic: 3997695 Time: 0.0695345
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4194303 Time: 0.0590979
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4259839 Time: 0.0820549
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4587519 Time: 0.0565135
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4653055 Time: 0.114336
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4915199 Time: 0.0696503
[11/24/2022-12:14:08] [V] [TRT] Tactic: 4980735 Time: 0.0594255
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5177343 Time: 0.112843
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5242879 Time: 0.0840594
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5373951 Time: 0.124672
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5570559 Time: 0.185083
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5767167 Time: 0.203456
[11/24/2022-12:14:08] [V] [TRT] Tactic: 5898239 Time: 0.111262
[11/24/2022-12:14:08] [V] [TRT] Tactic: 6225919 Time: 0.0847931
[11/24/2022-12:14:08] [V] [TRT] Tactic: 6291455 Time: 0.123323
[11/24/2022-12:14:08] [V] [TRT] Tactic: 6815743 Time: 0.100661
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7012351 Time: 0.087744
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7077887 Time: 0.0897989
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7143423 Time: 0.138201
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7208959 Time: 0.0952549
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7340031 Time: 0.121349
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7536639 Time: 0.175973
[11/24/2022-12:14:08] [V] [TRT] Tactic: 7733247 Time: 0.105646
[11/24/2022-12:14:08] [V] [TRT] Tactic: 8191999 Time: 0.0777851
[11/24/2022-12:14:08] [V] [TRT] Tactic: 8716287 Time: 0.115607
[11/24/2022-12:14:08] [V] [TRT] Tactic: 9109503 Time: 0.0900731
[11/24/2022-12:14:08] [V] [TRT] Tactic: 9568255 Time: 0.0739154
[11/24/2022-12:14:08] [V] [TRT] Tactic: 10354687 Time: 0.0715291
[11/24/2022-12:14:08] [V] [TRT] Tactic: 10747903 Time: 0.102935
[11/24/2022-12:14:08] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0565135
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CudnnConvolution)
[11/24/2022-12:14:09] [V] [TRT] Tactic: 0 Time: 0.0526918
[11/24/2022-12:14:09] [V] [TRT] Tactic: 1 Time: 0.0523368
[11/24/2022-12:14:09] [V] [TRT] Tactic: 2 Time: 0.159735
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4 Time: 6.05176
[11/24/2022-12:14:09] [V] [TRT] Tactic: 5 Time: 0.267195
[11/24/2022-12:14:09] [V] [TRT] Tactic: 56 Time: 0.0530834
[11/24/2022-12:14:09] [V] [TRT] Tactic: 57 Time: 0.0556038
[11/24/2022-12:14:09] [V] [TRT] Tactic: 58 Time: 0.167022
[11/24/2022-12:14:09] [V] [TRT] Tactic: 60 Time: 6.03467
[11/24/2022-12:14:09] [V] [TRT] Tactic: 61 Time: 0.269088
[11/24/2022-12:14:09] [V] [TRT] Tactic: 112 Time: 0.0530423
[11/24/2022-12:14:09] [V] [TRT] Tactic: 113 Time: 0.0523794
[11/24/2022-12:14:09] [V] [TRT] Tactic: 114 Time: 0.162592
[11/24/2022-12:14:09] [V] [TRT] Tactic: 116 Time: 5.86008
[11/24/2022-12:14:09] [V] [TRT] Tactic: 117 Time: 0.273595
[11/24/2022-12:14:09] [V] [TRT] Fastest Tactic: 1 Time: 0.0523368
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:09] [V] [TRT] Tactic: 621442388677115936 Time: 0.156306
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:09] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0854057
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:09] [V] [TRT] Tactic: 3377996665278764661 Time: 0.296526
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0913371
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0683794
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4918658762935651592 Time: 0.150848
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:09] [V] [TRT] Tactic: 5779835512569528575 Time: 0.121591
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:09] [V] [TRT] Tactic: 5837905844602864231 Time: 0.10552
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:09] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0711177
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:09] [V] [TRT] Tactic: 8048119769507926928 Time: 0.153403
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:09] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0854217
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:09] [V] [TRT] Tactic: -8766093103475083267 Time: 0.078864
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:09] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0400034
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:09] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0434034
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:09] [V] [TRT] Tactic: -6273689210331812572 Time: 0.115399
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:09] [V] [TRT] Tactic: -4562045946847239058 Time: 0.147529
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:09] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0635032
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:09] [V] [TRT] Tactic: -2777237991111865351 Time: 0.161253
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:09] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0870217
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:09] [V] [TRT] Tactic: -1349585930542925704 Time: 0.111095
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:09] [V] [TRT] Tactic: -1123676555321336786 Time: 0.117669
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:09] [V] [TRT] Tactic: -701551393537224327 Time: 0.0680594
[11/24/2022-12:14:09] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0400034
[11/24/2022-12:14:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:09] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(236544,1,2688,16) ***************
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:09] [V] [TRT] Tactic: 1162498931361159915 Time: 0.121145
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 1663866669559596164
[11/24/2022-12:14:09] [V] [TRT] Tactic: 1663866669559596164 Time: 0.106725
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 2860655430572478466
[11/24/2022-12:14:09] [V] [TRT] Tactic: 2860655430572478466 Time: 0.0763909
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:09] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0742789
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4474630279712975759
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4474630279712975759 Time: 0.0611261
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 4479823862704990365
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4479823862704990365 Time: 0.0603733
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 4696204239951173149
[11/24/2022-12:14:09] [V] [TRT] Tactic: 4696204239951173149 Time: 0.0771726
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 5778138195697110003
[11/24/2022-12:14:09] [V] [TRT] Tactic: 5778138195697110003 Time: 0.108722
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:09] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0710629
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 8918020581761223752
[11/24/2022-12:14:09] [V] [TRT] Tactic: 8918020581761223752 Time: 0.106743
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -5905193483742532701
[11/24/2022-12:14:09] [V] [TRT] Tactic: -5905193483742532701 Time: 0.0739611
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -4035591156787122265
[11/24/2022-12:14:09] [V] [TRT] Tactic: -4035591156787122265 Time: 0.0596038
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: -2809379259463049391
[11/24/2022-12:14:09] [V] [TRT] Tactic: -2809379259463049391 Time: 0.109429
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: -1985235291706575900
[11/24/2022-12:14:09] [V] [TRT] Tactic: -1985235291706575900 Time: 0.106016
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: ampere_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -504296718212024303
[11/24/2022-12:14:09] [V] [TRT] Tactic: -504296718212024303 Time: 0.107648
[11/24/2022-12:14:09] [V] [TRT] Fastest Tactic: -4035591156787122265 Time: 0.0596038
[11/24/2022-12:14:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4035591156787122265
[11/24/2022-12:14:09] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(59136,1:4,672,4) ***************
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:09] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:09] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0568198
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0558918
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0685227
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0812457
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:10] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0590126
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:10] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0691718
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:10] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0658194
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:10] [V] [TRT] Tactic: -1450865838092804082 Time: 0.093616
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:10] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0613074
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:10] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0566659
[11/24/2022-12:14:10] [V] [TRT] Fastest Tactic: 2536540085349545921 Time: 0.0558918
[11/24/2022-12:14:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2536540085349545921
[11/24/2022-12:14:10] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CudnnConvolution)
[11/24/2022-12:14:10] [V] [TRT] Tactic: 0 Time: 0.0501379
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1 Time: 0.0501105
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2 Time: 0.13003
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4 Time: 5.76237
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5 Time: 0.215707
[11/24/2022-12:14:10] [V] [TRT] Tactic: 56 Time: 0.0506514
[11/24/2022-12:14:10] [V] [TRT] Tactic: 58 Time: 0.130478
[11/24/2022-12:14:10] [V] [TRT] Tactic: 60 Time: 5.86134
[11/24/2022-12:14:10] [V] [TRT] Tactic: 61 Time: 0.215643
[11/24/2022-12:14:10] [V] [TRT] Fastest Tactic: 1 Time: 0.0501105
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1
[11/24/2022-12:14:10] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(236544,14784,168,1) ***************
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(118272,14784:2,168,1) ***************
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (FusedConvActConvolution)
[11/24/2022-12:14:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0276465
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:10] [V] [TRT] Tactic: 3891805945559659536 Time: 0.094816
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0421874
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0419886
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0405497
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:10] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0260122
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0717509
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0260907
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:10] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0944366
[11/24/2022-12:14:10] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0260122
[11/24/2022-12:14:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:10] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:10] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(29568,1:8,336,2) ***************
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CudaDepthwiseConvolution)
[11/24/2022-12:14:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:10] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:10] [V] [TRT] Tactic: 254850674756030979 Time: 0.0342272
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0343762
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0261371
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0341285
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0204643
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0756846
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0409657
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1838082074606840426 Time: 0.028821
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:10] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0449554
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0468903
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0293979
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0532769
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0678019
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:10] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0287269
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:10] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0214041
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:10] [V] [TRT] Tactic: 3359475309458902373 Time: 0.015275
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:10] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0477867
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:10] [V] [TRT] Tactic: 3513075359009385578 Time: 0.035848
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:10] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0339721
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0636754
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0206002
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0291666
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0344101
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:10] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0289271
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0341806
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0342464
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0288841
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0400149
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:10] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0311259
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0395794
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0340901
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0473714
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0467954
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0720503
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:10] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0398423
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:10] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0208104
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:10] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0262019
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:10] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0266651
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:10] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0449063
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:10] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0449554
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:10] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0305893
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:10] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207105
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:10] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0303589
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:10] [V] [TRT] Tactic: -8604374562669615024 Time: 0.061216
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:10] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0337527
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:10] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0312393
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:10] [V] [TRT] Tactic: -8131857373260504832 Time: 0.022929
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:10] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0645897
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:10] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0314862
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:10] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0540114
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:10] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0716731
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:10] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0394389
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:10] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0287762
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:10] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0148763
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:10] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0288192
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:10] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0478293
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:10] [V] [TRT] Tactic: -5127240325355316006 Time: 0.040208
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:10] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0359326
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0261493
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0773554
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0423794
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0260038
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:10] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371554
[11/24/2022-12:14:10] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:11] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0342839
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:11] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0648168
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3987638434926559037 Time: 0.07992
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0315099
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0203331
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207478
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0395909
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476354
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0180686
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0449737
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288832
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0425611
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0386743
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1985778916402815946 Time: 0.020719
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0269341
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0285751
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0614019
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0580328
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0371337
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:11] [V] [TRT] Tactic: -406984317033388136 Time: 0.0318254
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:11] [V] [TRT] Tactic: -331499326992534460 Time: 0.0258857
[11/24/2022-12:14:11] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0148763
[11/24/2022-12:14:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CublasConvolution)
[11/24/2022-12:14:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:11] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CudaDepthwiseConvolution)
[11/24/2022-12:14:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:11] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0615832
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:11] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0614034
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:11] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0621333
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:11] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0260808
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0341888
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:11] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0207889
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:11] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0342775
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:11] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0258347
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0210051
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1425085658556684465 Time: 0.026029
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:11] [V] [TRT] Tactic: -108011214168778087 Time: 0.020866
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:11] [V] [TRT] Tactic: -42427192380281294 Time: 0.034059
[11/24/2022-12:14:11] [V] [TRT] Fastest Tactic: -6580271968881459581 Time: 0.0207889
[11/24/2022-12:14:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6580271968881459581
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(236544,14784,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:11] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0162179
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:11] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0167385
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:11] [V] [TRT] Tactic: -5287526117701381005 Time: 0.017956
[11/24/2022-12:14:11] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0162179
[11/24/2022-12:14:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:14:11] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0181949
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:14:11] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0203263
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4178917718361232468 Time: 0.024448
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:14:11] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0324672
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:14:11] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0302757
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:14:11] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0196171
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:14:11] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0402171
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:14:11] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0265585
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:14:11] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0257394
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:14:11] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0301001
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:14:11] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0320686
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:14:11] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0239802
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:14:11] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0326647
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:14:11] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0198297
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:14:11] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0239299
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:14:11] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0292928
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0302162
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0242895
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0235651
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0230433
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0238857
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:14:11] [V] [TRT] Tactic: -621838502160440068 Time: 0.025155
[11/24/2022-12:14:11] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0181949
[11/24/2022-12:14:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_772 (CaskConvolution)
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:14:11] [V] [TRT] Tactic: 424230345342282109 Time: 0.0205368
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:14:11] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0312073
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:14:11] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0180429
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0342053
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:14:11] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0232522
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0258758
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0309211
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0152375
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0341513
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0261836
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:14:11] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0232209
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:14:11] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0205211
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:14:11] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0202474
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:14:11] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0185674
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:14:11] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0150848
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0178057
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0291639
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:14:11] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0423394
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:14:11] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0152809
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1712174008006584201 Time: 0.033259
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:14:11] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0194023
[11/24/2022-12:14:11] [V] [TRT] node_of_772 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:14:11] [V] [TRT] Tactic: -50323486981480818 Time: 0.0186897
[11/24/2022-12:14:11] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0150848
[11/24/2022-12:14:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:14:11] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:11] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_775 (CudaDepthwiseConvolution)
[11/24/2022-12:14:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_775 (FusedConvActConvolution)
[11/24/2022-12:14:11] [V] [TRT] Tactic: 589823 Time: 0.091536
[11/24/2022-12:14:11] [V] [TRT] Tactic: 786431 Time: 0.0532099
[11/24/2022-12:14:11] [V] [TRT] Tactic: 1638399 Time: 0.063619
[11/24/2022-12:14:11] [V] [TRT] Tactic: 2097151 Time: 0.0706072
[11/24/2022-12:14:11] [V] [TRT] Tactic: 3997695 Time: 0.0595474
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4194303 Time: 0.0505143
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4259839 Time: 0.0699383
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4587519 Time: 0.0528518
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4915199 Time: 0.0582202
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4980735 Time: 0.0511253
[11/24/2022-12:14:11] [V] [TRT] Tactic: 5767167 Time: 0.194386
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7012351 Time: 0.0749829
[11/24/2022-12:14:11] [V] [TRT] Tactic: 7143423 Time: 0.0865486
[11/24/2022-12:14:11] [V] [TRT] Tactic: 8191999 Time: 0.066397
[11/24/2022-12:14:11] [V] [TRT] Tactic: 9109503 Time: 0.074416
[11/24/2022-12:14:11] [V] [TRT] Tactic: 9568255 Time: 0.0621227
[11/24/2022-12:14:11] [V] [TRT] Tactic: 10354687 Time: 0.064317
[11/24/2022-12:14:11] [V] [TRT] Fastest Tactic: 4194303 Time: 0.0505143
[11/24/2022-12:14:11] [V] [TRT] --------------- Timing Runner: node_of_775 (CudnnConvolution)
[11/24/2022-12:14:11] [V] [TRT] Tactic: 0 Time: 0.0505387
[11/24/2022-12:14:11] [V] [TRT] Tactic: 1 Time: 0.0488137
[11/24/2022-12:14:11] [V] [TRT] Tactic: 2 Time: 0.103152
[11/24/2022-12:14:11] [V] [TRT] Tactic: 4 Time: 4.96202
[11/24/2022-12:14:11] [V] [TRT] Tactic: 5 Time: 0.264526
[11/24/2022-12:14:11] [V] [TRT] Tactic: 56 Time: 0.0512991
[11/24/2022-12:14:11] [V] [TRT] Tactic: 57 Time: 0.0503649
[11/24/2022-12:14:11] [V] [TRT] Tactic: 58 Time: 0.106379
[11/24/2022-12:14:12] [V] [TRT] Tactic: 60 Time: 4.76924
[11/24/2022-12:14:12] [V] [TRT] Tactic: 61 Time: 0.27115
[11/24/2022-12:14:12] [V] [TRT] Tactic: 112 Time: 0.0506057
[11/24/2022-12:14:12] [V] [TRT] Tactic: 113 Time: 0.0491185
[11/24/2022-12:14:12] [V] [TRT] Tactic: 114 Time: 0.103399
[11/24/2022-12:14:12] [V] [TRT] Tactic: 116 Time: 5.06563
[11/24/2022-12:14:12] [V] [TRT] Tactic: 117 Time: 0.266299
[11/24/2022-12:14:12] [V] [TRT] Fastest Tactic: 1 Time: 0.0488137
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:12] [V] [TRT] Tactic: 621442388677115936 Time: 0.151273
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:12] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0750789
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:12] [V] [TRT] Tactic: 3377996665278764661 Time: 0.292032
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:12] [V] [TRT] Tactic: 4032904638566464623 Time: 0.086096
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:12] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0662659
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:12] [V] [TRT] Tactic: 4918658762935651592 Time: 0.143122
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:12] [V] [TRT] Tactic: 5779835512569528575 Time: 0.117534
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:12] [V] [TRT] Tactic: 5837905844602864231 Time: 0.101799
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:12] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0692952
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:12] [V] [TRT] Tactic: 8048119769507926928 Time: 0.149883
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:12] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0814606
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:12] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0792823
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:12] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0396983
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:12] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0440411
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:12] [V] [TRT] Tactic: -6273689210331812572 Time: 0.116217
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:12] [V] [TRT] Tactic: -4562045946847239058 Time: 0.15285
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:12] [V] [TRT] Tactic: -4337126844824617177 Time: 0.062528
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:12] [V] [TRT] Tactic: -2777237991111865351 Time: 0.156763
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0858583
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1349585930542925704 Time: 0.10115
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1123676555321336786 Time: 0.116926
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:12] [V] [TRT] Tactic: -701551393537224327 Time: 0.0671665
[11/24/2022-12:14:12] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0396983
[11/24/2022-12:14:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(310464,1,3528,21) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:12] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122286
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:12] [V] [TRT] Tactic: 3887292144336338310 Time: 0.079536
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:12] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0740937
[11/24/2022-12:14:12] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0740937
[11/24/2022-12:14:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:12] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0615192
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:12] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0627764
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:12] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0707383
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:12] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0834103
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:12] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0609554
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:12] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0714377
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:12] [V] [TRT] Tactic: -6073218138311523634 Time: 0.069408
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0957006
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0648472
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0585006
[11/24/2022-12:14:12] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0585006
[11/24/2022-12:14:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CudnnConvolution)
[11/24/2022-12:14:12] [V] [TRT] Tactic: 0 Time: 0.049597
[11/24/2022-12:14:12] [V] [TRT] Tactic: 1 Time: 0.049501
[11/24/2022-12:14:12] [V] [TRT] Tactic: 2 Time: 0.100608
[11/24/2022-12:14:12] [V] [TRT] Tactic: 4 Time: 4.88012
[11/24/2022-12:14:12] [V] [TRT] Tactic: 5 Time: 0.220466
[11/24/2022-12:14:12] [V] [TRT] Tactic: 56 Time: 0.0492739
[11/24/2022-12:14:12] [V] [TRT] Tactic: 58 Time: 0.100704
[11/24/2022-12:14:12] [V] [TRT] Tactic: 60 Time: 4.78462
[11/24/2022-12:14:12] [V] [TRT] Tactic: 61 Time: 0.222281
[11/24/2022-12:14:12] [V] [TRT] Fastest Tactic: 56 Time: 0.0492739
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (FusedConvActConvolution)
[11/24/2022-12:14:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:12] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0275985
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:12] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0947291
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:12] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0421611
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:12] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0420091
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:12] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0411371
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:12] [V] [TRT] Tactic: 7392644644614664811 Time: 0.026003
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:12] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0714316
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:12] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0260564
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:12] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0945189
[11/24/2022-12:14:12] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.026003
[11/24/2022-12:14:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CudaDepthwiseConvolution)
[11/24/2022-12:14:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CublasConvolution)
[11/24/2022-12:14:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:12] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:12] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:12] [V] [TRT] Tactic: 254850674756030979 Time: 0.0343077
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0345883
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0262149
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0341888
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0207282
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0765234
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0411851
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1838082074606840426 Time: 0.028725
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0449509
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0461189
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0291301
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2559328254295148085 Time: 0.053184
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0670339
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0288741
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0208614
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0151918
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0477531
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0348974
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3704534001553878387 Time: 0.033771
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0639253
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0207184
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0292069
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0343963
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0289819
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0341541
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0342171
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0288347
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0401931
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0312722
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:13] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0395931
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:13] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0340782
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:13] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0475669
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:13] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0466171
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:13] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0719109
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:13] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0397109
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:13] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0208914
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:13] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0262453
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:13] [V] [TRT] Tactic: 8095507026323593899 Time: 0.026544
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:13] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0451143
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:13] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0449109
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:13] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0308544
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:13] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0206753
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:13] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0301906
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:13] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0612724
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:13] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0324974
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:13] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0312576
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:13] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0226109
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:13] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0643703
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:13] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0313591
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:13] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0542065
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:13] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0718217
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:13] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0395074
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0287506
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0151328
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0286985
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0476358
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0399269
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0365989
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0262347
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0774286
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0422811
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0259893
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4293222705763522367 Time: 0.03728
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0342574
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0646735
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:13] [V] [TRT] Tactic: -3987638434926559037 Time: 0.080336
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:13] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314999
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:13] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0201354
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:13] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207941
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:13] [V] [TRT] Tactic: -3601464762214218301 Time: 0.039528
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:13] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476968
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:13] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0181617
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:13] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0451646
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:13] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0289417
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:13] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0424777
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:13] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0382286
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0207837
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1640527254204634147 Time: 0.026877
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0287735
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0610331
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1099247066487349374 Time: 0.057184
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0370651
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:13] [V] [TRT] Tactic: -406984317033388136 Time: 0.0319954
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:13] [V] [TRT] Tactic: -331499326992534460 Time: 0.0260404
[11/24/2022-12:14:13] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0151328
[11/24/2022-12:14:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:13] [V] [TRT] --------------- Timing Runner: node_of_775 (CudaDepthwiseConvolution)
[11/24/2022-12:14:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:13] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0621699
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0615787
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0635032
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0261074
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:13] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0343525
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:13] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208568
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0343845
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:13] [V] [TRT] Tactic: -4443833619060044580 Time: 0.025923
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:13] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0212402
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:13] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0262133
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:13] [V] [TRT] Tactic: -108011214168778087 Time: 0.0208327
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:13] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341129
[11/24/2022-12:14:13] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0208327
[11/24/2022-12:14:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:13] [V] [TRT] --------------- Timing Runner: node_of_775 (CaskConvolution)
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0162017
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0165948
[11/24/2022-12:14:13] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:13] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0179029
[11/24/2022-12:14:13] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0162017
[11/24/2022-12:14:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:13] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:13] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:13] [V] [TRT] --------------- Timing Runner: node_of_778 (CudaDepthwiseConvolution)
[11/24/2022-12:14:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:13] [V] [TRT] --------------- Timing Runner: node_of_778 (FusedConvActConvolution)
[11/24/2022-12:14:13] [V] [TRT] Tactic: 589823 Time: 0.0793829
[11/24/2022-12:14:13] [V] [TRT] Tactic: 786431 Time: 0.0530804
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1179647 Time: 0.0971223
[11/24/2022-12:14:13] [V] [TRT] Tactic: 1638399 Time: 0.0586987
[11/24/2022-12:14:13] [V] [TRT] Tactic: 2097151 Time: 0.0730446
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3538943 Time: 0.0783474
[11/24/2022-12:14:13] [V] [TRT] Tactic: 3997695 Time: 0.0570743
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4194303 Time: 0.0497387
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4259839 Time: 0.0676495
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4587519 Time: 0.0502065
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4653055 Time: 0.0995314
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4915199 Time: 0.0589729
[11/24/2022-12:14:13] [V] [TRT] Tactic: 4980735 Time: 0.0489783
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5177343 Time: 0.0975109
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5242879 Time: 0.06768
[11/24/2022-12:14:13] [V] [TRT] Tactic: 5373951 Time: 0.110407
[11/24/2022-12:14:14] [V] [TRT] Tactic: 5767167 Time: 0.191122
[11/24/2022-12:14:14] [V] [TRT] Tactic: 5898239 Time: 0.0962583
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6225919 Time: 0.0743497
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6291455 Time: 0.0949691
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6815743 Time: 0.085648
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7012351 Time: 0.0726331
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7077887 Time: 0.0756274
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7143423 Time: 0.0867749
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7208959 Time: 0.0708632
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7340031 Time: 0.105753
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7536639 Time: 0.110702
[11/24/2022-12:14:14] [V] [TRT] Tactic: 7733247 Time: 0.0822057
[11/24/2022-12:14:14] [V] [TRT] Tactic: 8191999 Time: 0.0628008
[11/24/2022-12:14:14] [V] [TRT] Tactic: 8716287 Time: 0.107522
[11/24/2022-12:14:14] [V] [TRT] Tactic: 9109503 Time: 0.0752549
[11/24/2022-12:14:14] [V] [TRT] Tactic: 9568255 Time: 0.0603718
[11/24/2022-12:14:14] [V] [TRT] Tactic: 10354687 Time: 0.064224
[11/24/2022-12:14:14] [V] [TRT] Tactic: 10747903 Time: 0.0791817
[11/24/2022-12:14:14] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0489783
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CudnnConvolution)
[11/24/2022-12:14:14] [V] [TRT] Tactic: 0 Time: 0.0492922
[11/24/2022-12:14:14] [V] [TRT] Tactic: 1 Time: 0.0498987
[11/24/2022-12:14:14] [V] [TRT] Tactic: 2 Time: 0.070624
[11/24/2022-12:14:14] [V] [TRT] Tactic: 4 Time: 3.74771
[11/24/2022-12:14:14] [V] [TRT] Tactic: 5 Time: 0.261207
[11/24/2022-12:14:14] [V] [TRT] Tactic: 56 Time: 0.04816
[11/24/2022-12:14:14] [V] [TRT] Tactic: 57 Time: 0.0497935
[11/24/2022-12:14:14] [V] [TRT] Tactic: 58 Time: 0.0704
[11/24/2022-12:14:14] [V] [TRT] Tactic: 60 Time: 3.92334
[11/24/2022-12:14:14] [V] [TRT] Tactic: 61 Time: 0.26085
[11/24/2022-12:14:14] [V] [TRT] Tactic: 112 Time: 0.0481722
[11/24/2022-12:14:14] [V] [TRT] Tactic: 113 Time: 0.0483855
[11/24/2022-12:14:14] [V] [TRT] Tactic: 114 Time: 0.070272
[11/24/2022-12:14:14] [V] [TRT] Tactic: 116 Time: 3.78585
[11/24/2022-12:14:14] [V] [TRT] Tactic: 117 Time: 0.258103
[11/24/2022-12:14:14] [V] [TRT] Fastest Tactic: 56 Time: 0.04816
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:14] [V] [TRT] Tactic: 621442388677115936 Time: 0.15221
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:14] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0738286
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:14] [V] [TRT] Tactic: 3377996665278764661 Time: 0.290254
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:14] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0857234
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:14] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0657737
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:14] [V] [TRT] Tactic: 4918658762935651592 Time: 0.141408
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:14] [V] [TRT] Tactic: 5779835512569528575 Time: 0.117095
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:14] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0995474
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0704107
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:14] [V] [TRT] Tactic: 8048119769507926928 Time: 0.14523
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:14] [V] [TRT] Tactic: 9151672657204310840 Time: 0.081488
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:14] [V] [TRT] Tactic: -8766093103475083267 Time: 0.078208
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:14] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0372606
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:14] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0406823
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:14] [V] [TRT] Tactic: -6273689210331812572 Time: 0.115694
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:14] [V] [TRT] Tactic: -4562045946847239058 Time: 0.148434
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:14] [V] [TRT] Tactic: -4337126844824617177 Time: 0.063299
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:14] [V] [TRT] Tactic: -2777237991111865351 Time: 0.156896
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:14] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0845714
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:14] [V] [TRT] Tactic: -1349585930542925704 Time: 0.108014
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:14] [V] [TRT] Tactic: -1123676555321336786 Time: 0.117019
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:14] [V] [TRT] Tactic: -701551393537224327 Time: 0.0688579
[11/24/2022-12:14:14] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0372606
[11/24/2022-12:14:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:14] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(310464,1,3528,21) ***************
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:14] [V] [TRT] Tactic: 1162498931361159915 Time: 0.123038
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:14] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0801211
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0742834
[11/24/2022-12:14:14] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0742834
[11/24/2022-12:14:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:14:14] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:14] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:14] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0606918
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:14] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0615192
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0719017
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:14] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0840526
[11/24/2022-12:14:14] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:15] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0614964
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:15] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0710796
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:15] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0689783
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0952297
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0649996
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0595703
[11/24/2022-12:14:15] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0595703
[11/24/2022-12:14:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:15] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CudnnConvolution)
[11/24/2022-12:14:15] [V] [TRT] Tactic: 0 Time: 0.0497539
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1 Time: 0.0506255
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2 Time: 0.0704213
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4 Time: 3.82504
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5 Time: 0.180782
[11/24/2022-12:14:15] [V] [TRT] Tactic: 56 Time: 0.0492952
[11/24/2022-12:14:15] [V] [TRT] Tactic: 58 Time: 0.070333
[11/24/2022-12:14:15] [V] [TRT] Tactic: 60 Time: 3.55975
[11/24/2022-12:14:15] [V] [TRT] Tactic: 61 Time: 0.179794
[11/24/2022-12:14:15] [V] [TRT] Fastest Tactic: 56 Time: 0.0492952
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:14:15] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (FusedConvActConvolution)
[11/24/2022-12:14:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0278057
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:15] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0949577
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0419749
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0421051
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0404343
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:15] [V] [TRT] Tactic: 7392644644614664811 Time: 0.026019
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0712137
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0261478
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0944046
[11/24/2022-12:14:15] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.026019
[11/24/2022-12:14:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:15] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:15] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CudaDepthwiseConvolution)
[11/24/2022-12:14:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CublasConvolution)
[11/24/2022-12:14:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:15] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:15] [V] [TRT] Tactic: 254850674756030979 Time: 0.0341998
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1016009564074305832 Time: 0.034603
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0262933
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0342181
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0206465
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0764846
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0420937
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0288448
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:15] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0450206
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0473406
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0299365
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0559314
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0695223
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:15] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0290697
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:15] [V] [TRT] Tactic: 3071479995783211391 Time: 0.022895
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:15] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0154039
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:15] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0483566
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:15] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0369566
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:15] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0340261
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4278315135102886928 Time: 0.064064
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0207282
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0295771
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0344741
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:15] [V] [TRT] Tactic: 4802447371470387646 Time: 0.028768
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0340699
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0343543
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0288576
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0397074
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:15] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0312466
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0394709
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0339602
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6377497238381488891 Time: 0.047232
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0463509
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0717006
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:15] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0398446
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:15] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0206916
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:15] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0261531
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:15] [V] [TRT] Tactic: 8095507026323593899 Time: 0.026445
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:15] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0449531
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:15] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0448057
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:15] [V] [TRT] Tactic: 8764780417487154889 Time: 0.030069
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:15] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207726
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:15] [V] [TRT] Tactic: -9009272790678027912 Time: 0.029675
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:15] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0611078
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:15] [V] [TRT] Tactic: -8280443484414412687 Time: 0.032405
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:15] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0313253
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:15] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0227553
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:15] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0640107
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:15] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0315026
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:15] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0540038
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:15] [V] [TRT] Tactic: -6356316196810535311 Time: 0.072144
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:15] [V] [TRT] Tactic: -6063766379489217211 Time: 0.039552
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:15] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0288155
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:15] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0150971
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:15] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0287488
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:15] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0476171
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:15] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0397326
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:15] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0359326
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0261364
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0771589
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0423531
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0259901
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371874
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0342693
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:15] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0645547
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:15] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0802354
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:15] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314021
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:15] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0201514
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:15] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0208268
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:15] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0395417
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:15] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476229
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:15] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0180303
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:15] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0451383
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:15] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288101
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:15] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0424309
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:15] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0382949
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0207987
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0266857
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0286501
[11/24/2022-12:14:15] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:15] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0612602
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:16] [V] [TRT] Tactic: -1099247066487349374 Time: 0.057472
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:16] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0370846
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:16] [V] [TRT] Tactic: -406984317033388136 Time: 0.0316974
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:16] [V] [TRT] Tactic: -331499326992534460 Time: 0.0261935
[11/24/2022-12:14:16] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0150971
[11/24/2022-12:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_778 (CudaDepthwiseConvolution)
[11/24/2022-12:14:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:16] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0614507
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:16] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0613867
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:16] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0620831
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:16] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259444
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:16] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342208
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:16] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208242
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:16] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0342994
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:16] [V] [TRT] Tactic: -4443833619060044580 Time: 0.026016
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:16] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0209437
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:16] [V] [TRT] Tactic: -1425085658556684465 Time: 0.026163
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:16] [V] [TRT] Tactic: -108011214168778087 Time: 0.0206707
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:16] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341358
[11/24/2022-12:14:16] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0206707
[11/24/2022-12:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_778 (CaskConvolution)
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:16] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0161879
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:16] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0168935
[11/24/2022-12:14:16] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:16] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0179611
[11/24/2022-12:14:16] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0161879
[11/24/2022-12:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:16] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (CudaDepthwiseConvolution)
[11/24/2022-12:14:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (FusedConvActConvolution)
[11/24/2022-12:14:16] [V] [TRT] Tactic: 589823 Time: 0.0770331
[11/24/2022-12:14:16] [V] [TRT] Tactic: 786431 Time: 0.052896
[11/24/2022-12:14:16] [V] [TRT] Tactic: 1638399 Time: 0.0608152
[11/24/2022-12:14:16] [V] [TRT] Tactic: 2097151 Time: 0.0693928
[11/24/2022-12:14:16] [V] [TRT] Tactic: 3997695 Time: 0.0573044
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4194303 Time: 0.0499825
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4259839 Time: 0.0674575
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4587519 Time: 0.0515581
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4915199 Time: 0.0562331
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4980735 Time: 0.0487025
[11/24/2022-12:14:16] [V] [TRT] Tactic: 5767167 Time: 0.190793
[11/24/2022-12:14:16] [V] [TRT] Tactic: 7012351 Time: 0.0719977
[11/24/2022-12:14:16] [V] [TRT] Tactic: 7143423 Time: 0.0856091
[11/24/2022-12:14:16] [V] [TRT] Tactic: 8191999 Time: 0.0611931
[11/24/2022-12:14:16] [V] [TRT] Tactic: 9109503 Time: 0.0727589
[11/24/2022-12:14:16] [V] [TRT] Tactic: 9568255 Time: 0.055968
[11/24/2022-12:14:16] [V] [TRT] Tactic: 10354687 Time: 0.06288
[11/24/2022-12:14:16] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0487025
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (CudnnConvolution)
[11/24/2022-12:14:16] [V] [TRT] Tactic: 0 Time: 0.0486888
[11/24/2022-12:14:16] [V] [TRT] Tactic: 1 Time: 0.0504579
[11/24/2022-12:14:16] [V] [TRT] Tactic: 2 Time: 0.0407474
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4 Time: 2.7929
[11/24/2022-12:14:16] [V] [TRT] Tactic: 5 Time: 0.209371
[11/24/2022-12:14:16] [V] [TRT] Tactic: 56 Time: 0.0477912
[11/24/2022-12:14:16] [V] [TRT] Tactic: 57 Time: 0.0479665
[11/24/2022-12:14:16] [V] [TRT] Tactic: 58 Time: 0.0405566
[11/24/2022-12:14:16] [V] [TRT] Tactic: 60 Time: 2.70515
[11/24/2022-12:14:16] [V] [TRT] Tactic: 61 Time: 0.208155
[11/24/2022-12:14:16] [V] [TRT] Tactic: 112 Time: 0.0487512
[11/24/2022-12:14:16] [V] [TRT] Tactic: 113 Time: 0.0486507
[11/24/2022-12:14:16] [V] [TRT] Tactic: 114 Time: 0.0406789
[11/24/2022-12:14:16] [V] [TRT] Tactic: 116 Time: 2.7476
[11/24/2022-12:14:16] [V] [TRT] Tactic: 117 Time: 0.20315
[11/24/2022-12:14:16] [V] [TRT] Fastest Tactic: 58 Time: 0.0405566
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:16] [V] [TRT] Tactic: 621442388677115936 Time: 0.148018
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:16] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0750651
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:16] [V] [TRT] Tactic: 3377996665278764661 Time: 0.289787
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0850834
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0666849
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:16] [V] [TRT] Tactic: 4918658762935651592 Time: 0.139625
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:16] [V] [TRT] Tactic: 5779835512569528575 Time: 0.115991
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:16] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0985257
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:16] [V] [TRT] Tactic: 6210049212073459059 Time: 0.068035
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:16] [V] [TRT] Tactic: 8048119769507926928 Time: 0.145221
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:16] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0806103
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:16] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0786103
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:16] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0371657
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:16] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0423966
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:16] [V] [TRT] Tactic: -6273689210331812572 Time: 0.114791
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:16] [V] [TRT] Tactic: -4562045946847239058 Time: 0.146469
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:16] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0613257
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:16] [V] [TRT] Tactic: -2777237991111865351 Time: 0.156174
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:16] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0852069
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:16] [V] [TRT] Tactic: -1349585930542925704 Time: 0.102039
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:16] [V] [TRT] Tactic: -1123676555321336786 Time: 0.115013
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:16] [V] [TRT] Tactic: -701551393537224327 Time: 0.0667688
[11/24/2022-12:14:16] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0371657
[11/24/2022-12:14:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:16] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(310464,1,3528,21) ***************
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:16] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:16] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122018
[11/24/2022-12:14:16] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:16] [V] [TRT] Tactic: 3887292144336338310 Time: 0.079392
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0737371
[11/24/2022-12:14:17] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0737371
[11/24/2022-12:14:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:14:17] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0600076
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2536540085349545921 Time: 0.060669
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0705051
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0832731
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:17] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0619672
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:17] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0718514
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:17] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0692236
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:17] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0949874
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:17] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0645653
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:17] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0582583
[11/24/2022-12:14:17] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0582583
[11/24/2022-12:14:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:17] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CudnnConvolution)
[11/24/2022-12:14:17] [V] [TRT] Tactic: 0 Time: 0.0489676
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1 Time: 0.0492952
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2 Time: 0.0403429
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4 Time: 2.63896
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5 Time: 0.165417
[11/24/2022-12:14:17] [V] [TRT] Tactic: 56 Time: 0.0498926
[11/24/2022-12:14:17] [V] [TRT] Tactic: 58 Time: 0.0403611
[11/24/2022-12:14:17] [V] [TRT] Tactic: 60 Time: 2.74056
[11/24/2022-12:14:17] [V] [TRT] Tactic: 61 Time: 0.168105
[11/24/2022-12:14:17] [V] [TRT] Fastest Tactic: 2 Time: 0.0403429
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2
[11/24/2022-12:14:17] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (FusedConvActConvolution)
[11/24/2022-12:14:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0272206
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:17] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0940343
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0417691
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0415943
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6057304366605292508 Time: 0.040608
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:17] [V] [TRT] Tactic: 7392644644614664811 Time: 0.026067
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0704914
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4374269919094467161 Time: 0.026131
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:17] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0945646
[11/24/2022-12:14:17] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.026067
[11/24/2022-12:14:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:17] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:17] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CudaDepthwiseConvolution)
[11/24/2022-12:14:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CublasConvolution)
[11/24/2022-12:14:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:17] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:17] [V] [TRT] Tactic: 254850674756030979 Time: 0.0342016
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0344521
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0261691
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0340215
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0204454
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1576319725282257846 Time: 0.076112
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0414994
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0286043
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:17] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0449989
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0464629
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0292215
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0536198
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0676724
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:17] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0288585
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:17] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0215451
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:17] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0152745
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:17] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0478217
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:17] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0355237
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:17] [V] [TRT] Tactic: 3704534001553878387 Time: 0.034069
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0633798
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0206367
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0292608
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0342537
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:17] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0289563
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0341193
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0343113
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0287973
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0399177
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:17] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0313289
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0396194
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0341367
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0469989
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0465851
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6724319788728799540 Time: 0.071744
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:17] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0397897
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:17] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0207647
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:17] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0262278
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:17] [V] [TRT] Tactic: 8095507026323593899 Time: 0.026381
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:17] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0449394
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:17] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0449749
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:17] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0304786
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:17] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0206276
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:17] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0297746
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:17] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0614796
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:17] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0330405
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:17] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0312914
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:17] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0229433
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:17] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0644495
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:17] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0314478
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:17] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0548099
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:17] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0718766
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:17] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0395166
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:17] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0289728
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:17] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0148183
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:17] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0287168
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:17] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0478903
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:17] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0400446
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:17] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0365017
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0260533
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0775817
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0423851
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4379519430184503304 Time: 0.026
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0372777
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0341797
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:17] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0644221
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:17] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0799177
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:17] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0315328
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:17] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0200149
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:17] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0206393
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:17] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0393829
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:17] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476274
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:17] [V] [TRT] Tactic: -2878731503146438856 Time: 0.018036
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:17] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0450869
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:17] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288174
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:17] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0425017
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:17] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0380834
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:17] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208392
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:17] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0268114
[11/24/2022-12:14:17] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0287186
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0611139
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1099247066487349374 Time: 0.05776
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0369977
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:18] [V] [TRT] Tactic: -406984317033388136 Time: 0.0318226
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:18] [V] [TRT] Tactic: -331499326992534460 Time: 0.0260907
[11/24/2022-12:14:18] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0148183
[11/24/2022-12:14:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_781 (CudaDepthwiseConvolution)
[11/24/2022-12:14:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:18] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0620861
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:18] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0612846
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:18] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0630156
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:18] [V] [TRT] Tactic: 5592640619112287921 Time: 0.025968
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:18] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0343607
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:18] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208875
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:18] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0343141
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:18] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0257905
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:18] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0209672
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0261455
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:18] [V] [TRT] Tactic: -108011214168778087 Time: 0.0207909
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:18] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341422
[11/24/2022-12:14:18] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0207909
[11/24/2022-12:14:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_781 (CaskConvolution)
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:18] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0159263
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:18] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0165831
[11/24/2022-12:14:18] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:18] [V] [TRT] Tactic: -5287526117701381005 Time: 0.018
[11/24/2022-12:14:18] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0159263
[11/24/2022-12:14:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(310464,1,3528,21) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:18] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_787 (CudaDepthwiseConvolution)
[11/24/2022-12:14:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_787 (FusedConvActConvolution)
[11/24/2022-12:14:18] [V] [TRT] Tactic: 589823 Time: 0.0770789
[11/24/2022-12:14:18] [V] [TRT] Tactic: 786431 Time: 0.0539657
[11/24/2022-12:14:18] [V] [TRT] Tactic: 1638399 Time: 0.0586286
[11/24/2022-12:14:18] [V] [TRT] Tactic: 2097151 Time: 0.0693669
[11/24/2022-12:14:18] [V] [TRT] Tactic: 3997695 Time: 0.057117
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4194303 Time: 0.0485516
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4259839 Time: 0.0641097
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4587519 Time: 0.051645
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4915199 Time: 0.056029
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4980735 Time: 0.0477608
[11/24/2022-12:14:18] [V] [TRT] Tactic: 5767167 Time: 0.184046
[11/24/2022-12:14:18] [V] [TRT] Tactic: 7012351 Time: 0.0718903
[11/24/2022-12:14:18] [V] [TRT] Tactic: 7143423 Time: 0.0845806
[11/24/2022-12:14:18] [V] [TRT] Tactic: 8191999 Time: 0.061664
[11/24/2022-12:14:18] [V] [TRT] Tactic: 9109503 Time: 0.0740229
[11/24/2022-12:14:18] [V] [TRT] Tactic: 9568255 Time: 0.058816
[11/24/2022-12:14:18] [V] [TRT] Tactic: 10354687 Time: 0.0612373
[11/24/2022-12:14:18] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0477608
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_787 (CudnnConvolution)
[11/24/2022-12:14:18] [V] [TRT] Tactic: 0 Time: 0.0479116
[11/24/2022-12:14:18] [V] [TRT] Tactic: 1 Time: 0.04788
[11/24/2022-12:14:18] [V] [TRT] Tactic: 2 Time: 0.0423211
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4 Time: 2.70987
[11/24/2022-12:14:18] [V] [TRT] Tactic: 5 Time: 0.207291
[11/24/2022-12:14:18] [V] [TRT] Tactic: 56 Time: 0.0483261
[11/24/2022-12:14:18] [V] [TRT] Tactic: 57 Time: 0.048448
[11/24/2022-12:14:18] [V] [TRT] Tactic: 58 Time: 0.0406126
[11/24/2022-12:14:18] [V] [TRT] Tactic: 60 Time: 2.67098
[11/24/2022-12:14:18] [V] [TRT] Tactic: 61 Time: 0.205906
[11/24/2022-12:14:18] [V] [TRT] Tactic: 112 Time: 0.0479223
[11/24/2022-12:14:18] [V] [TRT] Tactic: 113 Time: 0.0489509
[11/24/2022-12:14:18] [V] [TRT] Tactic: 114 Time: 0.040544
[11/24/2022-12:14:18] [V] [TRT] Tactic: 116 Time: 2.67812
[11/24/2022-12:14:18] [V] [TRT] Tactic: 117 Time: 0.209454
[11/24/2022-12:14:18] [V] [TRT] Fastest Tactic: 114 Time: 0.040544
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:18] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:18] [V] [TRT] Tactic: 621442388677115936 Time: 0.148123
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:18] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0802171
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:18] [V] [TRT] Tactic: 3377996665278764661 Time: 0.289477
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0844891
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0646446
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:18] [V] [TRT] Tactic: 4918658762935651592 Time: 0.139335
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:18] [V] [TRT] Tactic: 5779835512569528575 Time: 0.116558
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:18] [V] [TRT] Tactic: 5837905844602864231 Time: 0.0972594
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:18] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0682911
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:18] [V] [TRT] Tactic: 8048119769507926928 Time: 0.148462
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:18] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0805394
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:18] [V] [TRT] Tactic: -8766093103475083267 Time: 0.078032
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:18] [V] [TRT] Tactic: -7491730084094677098 Time: 0.037168
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:18] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0429154
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:18] [V] [TRT] Tactic: -6273689210331812572 Time: 0.113671
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:18] [V] [TRT] Tactic: -4562045946847239058 Time: 0.146171
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:18] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0613242
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:18] [V] [TRT] Tactic: -2777237991111865351 Time: 0.157513
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0842377
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1349585930542925704 Time: 0.101262
[11/24/2022-12:14:18] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:18] [V] [TRT] Tactic: -1123676555321336786 Time: 0.117033
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:19] [V] [TRT] Tactic: -701551393537224327 Time: 0.0673158
[11/24/2022-12:14:19] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.037168
[11/24/2022-12:14:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(14784,1,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1162498931361159915 Time: 0.116965
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0681585
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0660861
[11/24/2022-12:14:19] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0660861
[11/24/2022-12:14:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(14784,1:4,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0464697
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2536540085349545921 Time: 0.038944
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0619383
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0726126
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:19] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0501364
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:19] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0587032
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:19] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0516069
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:19] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0871269
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:19] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0516175
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:19] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0472686
[11/24/2022-12:14:19] [V] [TRT] Fastest Tactic: 2536540085349545921 Time: 0.038944
[11/24/2022-12:14:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2536540085349545921
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CudnnConvolution)
[11/24/2022-12:14:19] [V] [TRT] Tactic: 0 Time: 0.048675
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1 Time: 0.0492526
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2 Time: 0.0404983
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4 Time: 2.60281
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5 Time: 0.163218
[11/24/2022-12:14:19] [V] [TRT] Tactic: 56 Time: 0.0485531
[11/24/2022-12:14:19] [V] [TRT] Tactic: 58 Time: 0.039688
[11/24/2022-12:14:19] [V] [TRT] Tactic: 60 Time: 2.63294
[11/24/2022-12:14:19] [V] [TRT] Tactic: 61 Time: 0.157769
[11/24/2022-12:14:19] [V] [TRT] Fastest Tactic: 58 Time: 0.039688
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 58
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(14784,14784,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(14784,14784:2,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (FusedConvActConvolution)
[11/24/2022-12:14:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0272434
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0946103
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0422686
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0417794
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0403566
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:19] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0260381
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0717669
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0260533
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:19] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0942514
[11/24/2022-12:14:19] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0260381
[11/24/2022-12:14:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(14784,1:8,168,1) ***************
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CudaDepthwiseConvolution)
[11/24/2022-12:14:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:19] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:19] [V] [TRT] Tactic: 254850674756030979 Time: 0.0341047
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0342885
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1044128949445110119 Time: 0.02624
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1156328698016730421 Time: 0.034165
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0206178
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0755886
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0412137
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0286674
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:19] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0447234
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0464251
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0293586
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0532846
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2657157263811141609 Time: 0.067488
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:19] [V] [TRT] Tactic: 2968605903460894194 Time: 0.028747
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0212434
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3359475309458902373 Time: 0.015333
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0477836
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0354103
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:19] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0341632
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0632198
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0206478
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0291026
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0342976
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:19] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0288951
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0339191
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0343433
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5205510332404400949 Time: 0.0288274
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0398103
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:19] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0310738
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0396103
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0341184
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0475897
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0466583
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0718743
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:19] [V] [TRT] Tactic: 6859477213531075460 Time: 0.040008
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:19] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0208385
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:19] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0261189
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:19] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0264648
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:19] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0448446
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:19] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0450514
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:19] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0302619
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:19] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207007
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:19] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0300105
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:19] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0610423
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:19] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0340965
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:19] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0314021
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:19] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0229786
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:19] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0645608
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:19] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0314752
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:19] [V] [TRT] Tactic: -7089118800560870395 Time: 0.054685
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:19] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0720251
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:19] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0397486
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:19] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0289189
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:19] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0149161
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:19] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0287909
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:19] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0477242
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:19] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0398434
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:19] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0355575
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0262644
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0772869
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4548822885169694805 Time: 0.042328
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0259832
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371451
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0341861
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:19] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0646842
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:19] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0801143
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:19] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314615
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:19] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0202651
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:19] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207171
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:19] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0397086
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:19] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0475657
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:19] [V] [TRT] Tactic: -2878731503146438856 Time: 0.018032
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:19] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0450034
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:19] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0290149
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:19] [V] [TRT] Tactic: -2032577876140256150 Time: 0.042384
[11/24/2022-12:14:19] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:20] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0386229
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0209169
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0267756
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0286482
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1242202084391243207 Time: 0.061379
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0578469
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0371337
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:20] [V] [TRT] Tactic: -406984317033388136 Time: 0.0317961
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:20] [V] [TRT] Tactic: -331499326992534460 Time: 0.0261051
[11/24/2022-12:14:20] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0149161
[11/24/2022-12:14:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(14784,1:16,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_787 (CublasConvolution)
[11/24/2022-12:14:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:20] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_787 (CudaDepthwiseConvolution)
[11/24/2022-12:14:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:20] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0618712
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:20] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0613608
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:20] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0623634
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:20] [V] [TRT] Tactic: 5592640619112287921 Time: 0.026019
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:20] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342391
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:20] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208503
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:20] [V] [TRT] Tactic: -5576936487443445631 Time: 0.034347
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:20] [V] [TRT] Tactic: -4443833619060044580 Time: 0.025939
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:20] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0212891
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:20] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0261585
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:20] [V] [TRT] Tactic: -108011214168778087 Time: 0.0208052
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:20] [V] [TRT] Tactic: -42427192380281294 Time: 0.034272
[11/24/2022-12:14:20] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0208052
[11/24/2022-12:14:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_787 (CaskConvolution)
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:20] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0156329
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:20] [V] [TRT] Tactic: 5104832031493112835 Time: 0.015936
[11/24/2022-12:14:20] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:20] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0179343
[11/24/2022-12:14:20] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0156329
[11/24/2022-12:14:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:20] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_790 (CudaDepthwiseConvolution)
[11/24/2022-12:14:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_790 (FusedConvActConvolution)
[11/24/2022-12:14:20] [V] [TRT] Tactic: 589823 Time: 0.103566
[11/24/2022-12:14:20] [V] [TRT] Tactic: 786431 Time: 0.0624061
[11/24/2022-12:14:20] [V] [TRT] Tactic: 1638399 Time: 0.0690773
[11/24/2022-12:14:20] [V] [TRT] Tactic: 2097151 Time: 0.0846606
[11/24/2022-12:14:20] [V] [TRT] Tactic: 3997695 Time: 0.0686903
[11/24/2022-12:14:20] [V] [TRT] Tactic: 4194303 Time: 0.063709
[11/24/2022-12:14:20] [V] [TRT] Tactic: 4259839 Time: 0.0832366
[11/24/2022-12:14:20] [V] [TRT] Tactic: 4587519 Time: 0.0589836
[11/24/2022-12:14:20] [V] [TRT] Tactic: 4915199 Time: 0.0736869
[11/24/2022-12:14:20] [V] [TRT] Tactic: 4980735 Time: 0.0632823
[11/24/2022-12:14:20] [V] [TRT] Tactic: 5767167 Time: 0.203406
[11/24/2022-12:14:20] [V] [TRT] Tactic: 7012351 Time: 0.085632
[11/24/2022-12:14:20] [V] [TRT] Tactic: 7143423 Time: 0.145266
[11/24/2022-12:14:20] [V] [TRT] Tactic: 8191999 Time: 0.0785806
[11/24/2022-12:14:20] [V] [TRT] Tactic: 9109503 Time: 0.0859794
[11/24/2022-12:14:20] [V] [TRT] Tactic: 9568255 Time: 0.0730491
[11/24/2022-12:14:20] [V] [TRT] Tactic: 10354687 Time: 0.0715474
[11/24/2022-12:14:20] [V] [TRT] Fastest Tactic: 4587519 Time: 0.0589836
[11/24/2022-12:14:20] [V] [TRT] --------------- Timing Runner: node_of_790 (CudnnConvolution)
[11/24/2022-12:14:20] [V] [TRT] Tactic: 0 Time: 0.0556358
[11/24/2022-12:14:20] [V] [TRT] Tactic: 1 Time: 0.0563779
[11/24/2022-12:14:20] [V] [TRT] Tactic: 2 Time: 0.230729
[11/24/2022-12:14:20] [V] [TRT] Tactic: 4 Time: 9.75126
[11/24/2022-12:14:20] [V] [TRT] Tactic: 5 Time: 0.272
[11/24/2022-12:14:20] [V] [TRT] Tactic: 56 Time: 0.0555642
[11/24/2022-12:14:20] [V] [TRT] Tactic: 57 Time: 0.0559451
[11/24/2022-12:14:20] [V] [TRT] Tactic: 58 Time: 0.23013
[11/24/2022-12:14:20] [V] [TRT] Tactic: 60 Time: 9.64458
[11/24/2022-12:14:20] [V] [TRT] Tactic: 61 Time: 0.276219
[11/24/2022-12:14:20] [V] [TRT] Tactic: 112 Time: 0.0551726
[11/24/2022-12:14:20] [V] [TRT] Tactic: 113 Time: 0.0543238
[11/24/2022-12:14:20] [V] [TRT] Tactic: 114 Time: 0.229893
[11/24/2022-12:14:21] [V] [TRT] Tactic: 116 Time: 9.60558
[11/24/2022-12:14:21] [V] [TRT] Tactic: 117 Time: 0.269472
[11/24/2022-12:14:21] [V] [TRT] Fastest Tactic: 113 Time: 0.0543238
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:21] [V] [TRT] Tactic: 621442388677115936 Time: 0.155849
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:21] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0832091
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:21] [V] [TRT] Tactic: 3377996665278764661 Time: 0.295278
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:21] [V] [TRT] Tactic: 4032904638566464623 Time: 0.0889783
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:21] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0701592
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:21] [V] [TRT] Tactic: 4918658762935651592 Time: 0.147607
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:21] [V] [TRT] Tactic: 5779835512569528575 Time: 0.118971
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:21] [V] [TRT] Tactic: 5837905844602864231 Time: 0.107829
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:21] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0707124
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:21] [V] [TRT] Tactic: 8048119769507926928 Time: 0.152786
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:21] [V] [TRT] Tactic: 9151672657204310840 Time: 0.0851223
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:21] [V] [TRT] Tactic: -8766093103475083267 Time: 0.0802309
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:21] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0399863
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:21] [V] [TRT] Tactic: -6313876406580483184 Time: 0.044768
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:21] [V] [TRT] Tactic: -6273689210331812572 Time: 0.117246
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:21] [V] [TRT] Tactic: -4562045946847239058 Time: 0.154455
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:21] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0651048
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:21] [V] [TRT] Tactic: -2777237991111865351 Time: 0.160997
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:21] [V] [TRT] Tactic: -1918478037390720253 Time: 0.0867634
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:21] [V] [TRT] Tactic: -1349585930542925704 Time: 0.111472
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:21] [V] [TRT] Tactic: -1123676555321336786 Time: 0.119646
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:21] [V] [TRT] Tactic: -701551393537224327 Time: 0.070205
[11/24/2022-12:14:21] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0399863
[11/24/2022-12:14:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:21] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(310464,1,3528,21) ***************
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:21] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122384
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:21] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0796594
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:21] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0744663
[11/24/2022-12:14:21] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0744663
[11/24/2022-12:14:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:14:21] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:21] [V] [TRT] Tactic: 1373022415249282411 Time: 0.060832
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:21] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0598552
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:21] [V] [TRT] Tactic: 6031243482516294286 Time: 0.0715794
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:21] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0825211
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:21] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0609631
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:21] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0710095
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:21] [V] [TRT] Tactic: -6073218138311523634 Time: 0.0691124
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:21] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0954469
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:21] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0635505
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:21] [V] [TRT] Tactic: -1138876066247138089 Time: 0.0592
[11/24/2022-12:14:21] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.0592
[11/24/2022-12:14:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:21] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CudnnConvolution)
[11/24/2022-12:14:21] [V] [TRT] Tactic: 0 Time: 0.0522118
[11/24/2022-12:14:21] [V] [TRT] Tactic: 1 Time: 0.0524709
[11/24/2022-12:14:21] [V] [TRT] Tactic: 2 Time: 0.221216
[11/24/2022-12:14:21] [V] [TRT] Tactic: 4 Time: 9.58657
[11/24/2022-12:14:21] [V] [TRT] Tactic: 5 Time: 0.178985
[11/24/2022-12:14:21] [V] [TRT] Tactic: 56 Time: 0.0515337
[11/24/2022-12:14:21] [V] [TRT] Tactic: 58 Time: 0.218441
[11/24/2022-12:14:21] [V] [TRT] Tactic: 60 Time: 8.55398
[11/24/2022-12:14:21] [V] [TRT] Tactic: 61 Time: 0.197198
[11/24/2022-12:14:21] [V] [TRT] Fastest Tactic: 56 Time: 0.0515337
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 56
[11/24/2022-12:14:21] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:21] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (FusedConvActConvolution)
[11/24/2022-12:14:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:21] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:21] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0266392
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:21] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0938354
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:21] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0412354
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:21] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0410674
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:21] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0397886
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:21] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0246499
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:21] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0699246
[11/24/2022-12:14:21] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:21] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0262994
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0939246
[11/24/2022-12:14:22] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0246499
[11/24/2022-12:14:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CudaDepthwiseConvolution)
[11/24/2022-12:14:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:22] [V] [TRT] Tactic: 254850674756030979 Time: 0.0329234
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0346926
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0262621
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0328805
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0197691
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1576319725282257846 Time: 0.0751657
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0407394
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0267322
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0433154
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0454354
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0286903
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2559328254295148085 Time: 0.0534309
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2657157263811141609 Time: 0.0670019
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0284922
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0206309
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0147698
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0473966
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0366857
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0342373
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4278315135102886928 Time: 0.0641768
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4480294673430783793 Time: 0.0210834
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0307813
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0347584
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0300928
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0341531
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0345847
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5205510332404400949 Time: 0.029045
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0405863
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5398999388616959893 Time: 0.0313957
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6034364043891107501 Time: 0.0396686
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0343835
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0477562
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6468794451065529747 Time: 0.047456
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0720777
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6859477213531075460 Time: 0.0398149
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0207549
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0260937
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:22] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0266415
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:22] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0450914
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:22] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0449509
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:22] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0305243
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:22] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0206224
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:22] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0299474
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:22] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0611657
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:22] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0327461
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:22] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0312366
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:22] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0225757
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7410012245391920273 Time: 0.0640457
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0315712
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0540556
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:22] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0718057
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:22] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0395657
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0288869
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0149403
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0288283
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0475406
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0398903
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0363737
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0261859
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4796511246675321840 Time: 0.077472
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0424206
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4379519430184503304 Time: 0.0259771
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4293222705763522367 Time: 0.037304
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4152066959007262150 Time: 0.0341989
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0649371
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0803497
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314267
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3903342530518878192 Time: 0.020384
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207112
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0397749
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0476678
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0181114
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0451623
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0289966
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0425291
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0392297
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0208131
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0270133
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0288238
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0615451
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0583025
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0371543
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:22] [V] [TRT] Tactic: -406984317033388136 Time: 0.0321765
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:22] [V] [TRT] Tactic: -331499326992534460 Time: 0.0260495
[11/24/2022-12:14:22] [V] [TRT] Fastest Tactic: 3359475309458902373 Time: 0.0147698
[11/24/2022-12:14:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3359475309458902373
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CublasConvolution)
[11/24/2022-12:14:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CudaDepthwiseConvolution)
[11/24/2022-12:14:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:22] [V] [TRT] Tactic: 1508480131241957639 Time: 0.0615421
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0614629
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0623695
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259261
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0341605
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:22] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208444
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0342043
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:22] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0260008
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0209195
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1425085658556684465 Time: 0.0260861
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:22] [V] [TRT] Tactic: -108011214168778087 Time: 0.0207504
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:22] [V] [TRT] Tactic: -42427192380281294 Time: 0.0341111
[11/24/2022-12:14:22] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0207504
[11/24/2022-12:14:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0164069
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5104832031493112835 Time: 0.0166918
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5287526117701381005 Time: 0.017795
[11/24/2022-12:14:22] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0164069
[11/24/2022-12:14:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0187023
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:14:22] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0204709
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0252076
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0344421
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0318491
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0209215
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:14:22] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0422149
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:14:22] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0279611
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:14:22] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0274065
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0313893
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0343104
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7606074703023778034 Time: 0.0245257
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0341623
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:14:22] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0207275
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0271756
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0342784
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0350117
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3644377136375731441 Time: 0.0276411
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0273562
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:14:22] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0267291
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:14:22] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0273524
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:14:22] [V] [TRT] Tactic: -621838502160440068 Time: 0.0283131
[11/24/2022-12:14:22] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0187023
[11/24/2022-12:14:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:14:22] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:22] [V] [TRT] --------------- Timing Runner: node_of_790 (CaskConvolution)
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:14:22] [V] [TRT] Tactic: 424230345342282109 Time: 0.022001
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0353682
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:14:22] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0217835
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:14:22] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0384674
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:14:22] [V] [TRT] Tactic: 5730376045873629665 Time: 0.0249653
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7107586691882206281 Time: 0.0299438
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0355273
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0182566
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7515859573761964679 Time: 0.038216
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:14:22] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0298176
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:14:22] [V] [TRT] Tactic: 8142426754608472547 Time: 0.0259474
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:14:22] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0217607
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:14:22] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0214753
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0215791
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:14:22] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0160076
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:14:22] [V] [TRT] Tactic: -3773982102975252832 Time: 0.02036
[11/24/2022-12:14:22] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:14:23] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0330551
[11/24/2022-12:14:23] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:14:23] [V] [TRT] Tactic: -3514726588976755320 Time: 0.0473863
[11/24/2022-12:14:23] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:14:23] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0183177
[11/24/2022-12:14:23] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:14:23] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0380171
[11/24/2022-12:14:23] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:14:23] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0214407
[11/24/2022-12:14:23] [V] [TRT] node_of_790 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:14:23] [V] [TRT] Tactic: -50323486981480818 Time: 0.021583
[11/24/2022-12:14:23] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0160076
[11/24/2022-12:14:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:14:23] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:23] [V] [TRT] *************** Autotuning format combination: Float(7569408,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:23] [V] [TRT] --------------- Timing Runner: node_of_793 (CudaDepthwiseConvolution)
[11/24/2022-12:14:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:23] [V] [TRT] --------------- Timing Runner: node_of_793 (FusedConvActConvolution)
[11/24/2022-12:14:23] [V] [TRT] Tactic: 589823 Time: 0.0969897
[11/24/2022-12:14:23] [V] [TRT] Tactic: 786431 Time: 0.0620541
[11/24/2022-12:14:23] [V] [TRT] Tactic: 1638399 Time: 0.0764571
[11/24/2022-12:14:23] [V] [TRT] Tactic: 2097151 Time: 0.0808411
[11/24/2022-12:14:23] [V] [TRT] Tactic: 3997695 Time: 0.07144
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4194303 Time: 0.0579962
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4259839 Time: 0.086768
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4587519 Time: 0.0605791
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4915199 Time: 0.076784
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4980735 Time: 0.0577326
[11/24/2022-12:14:23] [V] [TRT] Tactic: 5767167 Time: 0.229189
[11/24/2022-12:14:23] [V] [TRT] Tactic: 7012351 Time: 0.0809669
[11/24/2022-12:14:23] [V] [TRT] Tactic: 7143423 Time: 0.122185
[11/24/2022-12:14:23] [V] [TRT] Tactic: 8191999 Time: 0.0772
[11/24/2022-12:14:23] [V] [TRT] Tactic: 9109503 Time: 0.0931794
[11/24/2022-12:14:23] [V] [TRT] Tactic: 9568255 Time: 0.0690088
[11/24/2022-12:14:23] [V] [TRT] Tactic: 10354687 Time: 0.0757554
[11/24/2022-12:14:23] [V] [TRT] Fastest Tactic: 4980735 Time: 0.0577326
[11/24/2022-12:14:23] [V] [TRT] --------------- Timing Runner: node_of_793 (CudnnConvolution)
[11/24/2022-12:14:23] [V] [TRT] Tactic: 0 Time: 0.0617158
[11/24/2022-12:14:23] [V] [TRT] Tactic: 1 Time: 0.0593722
[11/24/2022-12:14:23] [V] [TRT] Tactic: 2 Time: 0.189495
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4 Time: 7.35063
[11/24/2022-12:14:23] [V] [TRT] Tactic: 5 Time: 0.274999
[11/24/2022-12:14:23] [V] [TRT] Tactic: 56 Time: 0.0554316
[11/24/2022-12:14:23] [V] [TRT] Tactic: 57 Time: 0.0527482
[11/24/2022-12:14:23] [V] [TRT] Tactic: 58 Time: 0.165742
[11/24/2022-12:14:23] [V] [TRT] Tactic: 60 Time: 7.16731
[11/24/2022-12:14:23] [V] [TRT] Tactic: 61 Time: 0.269481
[11/24/2022-12:14:23] [V] [TRT] Tactic: 112 Time: 0.052893
[11/24/2022-12:14:23] [V] [TRT] Tactic: 113 Time: 0.0520838
[11/24/2022-12:14:23] [V] [TRT] Tactic: 114 Time: 0.165888
[11/24/2022-12:14:23] [V] [TRT] Tactic: 116 Time: 7.17876
[11/24/2022-12:14:23] [V] [TRT] Tactic: 117 Time: 0.269979
[11/24/2022-12:14:23] [V] [TRT] Fastest Tactic: 113 Time: 0.0520838
[11/24/2022-12:14:23] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:23] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 621442388677115936
[11/24/2022-12:14:23] [V] [TRT] Tactic: 621442388677115936 Time: 0.150208
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 1327459216264546184
[11/24/2022-12:14:23] [V] [TRT] Tactic: 1327459216264546184 Time: 0.0757691
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3377996665278764661
[11/24/2022-12:14:23] [V] [TRT] Tactic: 3377996665278764661 Time: 0.290496
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4032904638566464623
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4032904638566464623 Time: 0.085872
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 4549827808004681195
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4549827808004681195 Time: 0.0678415
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 4918658762935651592
[11/24/2022-12:14:23] [V] [TRT] Tactic: 4918658762935651592 Time: 0.146299
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 5779835512569528575
[11/24/2022-12:14:23] [V] [TRT] Tactic: 5779835512569528575 Time: 0.118581
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 5837905844602864231
[11/24/2022-12:14:23] [V] [TRT] Tactic: 5837905844602864231 Time: 0.101979
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 6210049212073459059
[11/24/2022-12:14:23] [V] [TRT] Tactic: 6210049212073459059 Time: 0.0703421
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 8048119769507926928
[11/24/2022-12:14:23] [V] [TRT] Tactic: 8048119769507926928 Time: 0.150487
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 9151672657204310840
[11/24/2022-12:14:23] [V] [TRT] Tactic: 9151672657204310840 Time: 0.083616
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -8766093103475083267
[11/24/2022-12:14:23] [V] [TRT] Tactic: -8766093103475083267 Time: 0.080448
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: -7491730084094677098
[11/24/2022-12:14:23] [V] [TRT] Tactic: -7491730084094677098 Time: 0.0396846
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: -6313876406580483184
[11/24/2022-12:14:23] [V] [TRT] Tactic: -6313876406580483184 Time: 0.0453531
[11/24/2022-12:14:23] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: -6273689210331812572
[11/24/2022-12:14:23] [V] [TRT] Tactic: -6273689210331812572 Time: 0.116553
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -4562045946847239058
[11/24/2022-12:14:24] [V] [TRT] Tactic: -4562045946847239058 Time: 0.14923
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: -4337126844824617177
[11/24/2022-12:14:24] [V] [TRT] Tactic: -4337126844824617177 Time: 0.0635048
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -2777237991111865351
[11/24/2022-12:14:24] [V] [TRT] Tactic: -2777237991111865351 Time: 0.159104
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: -1918478037390720253
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1918478037390720253 Time: 0.086064
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: -1349585930542925704
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1349585930542925704 Time: 0.105954
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: -1123676555321336786
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1123676555321336786 Time: 0.120354
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: -701551393537224327
[11/24/2022-12:14:24] [V] [TRT] Tactic: -701551393537224327 Time: 0.0683383
[11/24/2022-12:14:24] [V] [TRT] Fastest Tactic: -7491730084094677098 Time: 0.0396846
[11/24/2022-12:14:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7491730084094677098
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Float(7569408,1,86016,512) -> Float(310464,1,3528,21) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 1162498931361159915
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1162498931361159915 Time: 0.122565
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 3887292144336338310
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3887292144336338310 Time: 0.0823429
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 6185707384100198445
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6185707384100198445 Time: 0.0746857
[11/24/2022-12:14:24] [V] [TRT] Fastest Tactic: 6185707384100198445 Time: 0.0746857
[11/24/2022-12:14:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6185707384100198445
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Float(1892352,1:4,21504,128) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 1373022415249282411
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1373022415249282411 Time: 0.0602484
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 2536540085349545921
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2536540085349545921 Time: 0.0619154
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6031243482516294286
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6031243482516294286 Time: 0.070499
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 6832381412128253616
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6832381412128253616 Time: 0.0831246
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 7058864664858220889
[11/24/2022-12:14:24] [V] [TRT] Tactic: 7058864664858220889 Time: 0.0610606
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6407735577805887428
[11/24/2022-12:14:24] [V] [TRT] Tactic: -6407735577805887428 Time: 0.0711086
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -6073218138311523634
[11/24/2022-12:14:24] [V] [TRT] Tactic: -6073218138311523634 Time: 0.068829
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: -1450865838092804082
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1450865838092804082 Time: 0.0946354
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1366318165940453381
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1366318165940453381 Time: 0.0641585
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: -1138876066247138089
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1138876066247138089 Time: 0.058397
[11/24/2022-12:14:24] [V] [TRT] Fastest Tactic: -1138876066247138089 Time: 0.058397
[11/24/2022-12:14:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1138876066247138089
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Half(7569408,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CudnnConvolution)
[11/24/2022-12:14:24] [V] [TRT] Tactic: 0 Time: 0.0505234
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1 Time: 0.0506575
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2 Time: 0.159547
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4 Time: 7.03091
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5 Time: 0.180846
[11/24/2022-12:14:24] [V] [TRT] Tactic: 56 Time: 0.0514255
[11/24/2022-12:14:24] [V] [TRT] Tactic: 58 Time: 0.16229
[11/24/2022-12:14:24] [V] [TRT] Tactic: 60 Time: 7.06903
[11/24/2022-12:14:24] [V] [TRT] Tactic: 61 Time: 0.172512
[11/24/2022-12:14:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0505234
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Half(3784704,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (FusedConvActConvolution)
[11/24/2022-12:14:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 2195670545862694453
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2195670545862694453 Time: 0.0265211
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 3891805945559659536
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3891805945559659536 Time: 0.0933303
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 4418200634486186714
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4418200634486186714 Time: 0.0402549
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 5548126322150286555
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5548126322150286555 Time: 0.0407703
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 6057304366605292508
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6057304366605292508 Time: 0.0397966
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 7392644644614664811
[11/24/2022-12:14:24] [V] [TRT] Tactic: 7392644644614664811 Time: 0.0259063
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -4884039206922900293
[11/24/2022-12:14:24] [V] [TRT] Tactic: -4884039206922900293 Time: 0.0707291
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: -4374269919094467161
[11/24/2022-12:14:24] [V] [TRT] Tactic: -4374269919094467161 Time: 0.0261181
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -1546027692247304867
[11/24/2022-12:14:24] [V] [TRT] Tactic: -1546027692247304867 Time: 0.0943154
[11/24/2022-12:14:24] [V] [TRT] Fastest Tactic: 7392644644614664811 Time: 0.0259063
[11/24/2022-12:14:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7392644644614664811
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] *************** Autotuning format combination: Half(946176,1:8,10752,64) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CudaDepthwiseConvolution)
[11/24/2022-12:14:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:24] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:24] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 254850674756030979
[11/24/2022-12:14:24] [V] [TRT] Tactic: 254850674756030979 Time: 0.0340114
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1016009564074305832
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1016009564074305832 Time: 0.0342839
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x64_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 1044128949445110119
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1044128949445110119 Time: 0.0262834
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 1156328698016730421
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1156328698016730421 Time: 0.0340846
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 1362727228442059924
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1362727228442059924 Time: 0.0205192
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: 1576319725282257846
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1576319725282257846 Time: 0.075584
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 1832046141070096030
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1832046141070096030 Time: 0.0408423
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 1838082074606840426
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1838082074606840426 Time: 0.0286949
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: 1899296423087490472
[11/24/2022-12:14:24] [V] [TRT] Tactic: 1899296423087490472 Time: 0.0447589
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 2238656696610018305
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2238656696610018305 Time: 0.0459726
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 2541579301352125276
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2541579301352125276 Time: 0.0291291
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 2559328254295148085
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2559328254295148085 Time: 0.053437
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: 2657157263811141609
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2657157263811141609 Time: 0.066979
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 2968605903460894194
[11/24/2022-12:14:24] [V] [TRT] Tactic: 2968605903460894194 Time: 0.0287323
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 3071479995783211391
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3071479995783211391 Time: 0.0214328
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 3359475309458902373
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3359475309458902373 Time: 0.0152526
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 3362537467505018070
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3362537467505018070 Time: 0.0476206
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 3513075359009385578
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3513075359009385578 Time: 0.0352192
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 3704534001553878387
[11/24/2022-12:14:24] [V] [TRT] Tactic: 3704534001553878387 Time: 0.0340891
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 4278315135102886928
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4278315135102886928 Time: 0.063552
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 4480294673430783793
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4480294673430783793 Time: 0.020625
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 4540505769798915372
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4540505769798915372 Time: 0.0292462
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 4571819373777460444
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4571819373777460444 Time: 0.0345106
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 4802447371470387646
[11/24/2022-12:14:24] [V] [TRT] Tactic: 4802447371470387646 Time: 0.0290368
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5059676457552313631
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5059676457552313631 Time: 0.0342491
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 5070322914990170527
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5070322914990170527 Time: 0.0344448
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 5205510332404400949
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5205510332404400949 Time: 0.02896
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 5346855796032465921
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5346855796032465921 Time: 0.0411109
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 5398999388616959893
[11/24/2022-12:14:24] [V] [TRT] Tactic: 5398999388616959893 Time: 0.031488
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6034364043891107501
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6034364043891107501 Time: 0.039976
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x64_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 6372404953297521067
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6372404953297521067 Time: 0.0341541
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: 6377497238381488891
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6377497238381488891 Time: 0.0476785
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: 6468794451065529747
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6468794451065529747 Time: 0.0476419
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage3_warpsize1x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 6724319788728799540
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6724319788728799540 Time: 0.0725189
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 6859477213531075460
[11/24/2022-12:14:24] [V] [TRT] Tactic: 6859477213531075460 Time: 0.040376
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 7216571380637776659
[11/24/2022-12:14:24] [V] [TRT] Tactic: 7216571380637776659 Time: 0.0210109
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: 7609923741161019135
[11/24/2022-12:14:24] [V] [TRT] Tactic: 7609923741161019135 Time: 0.0264503
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: 8095507026323593899
[11/24/2022-12:14:24] [V] [TRT] Tactic: 8095507026323593899 Time: 0.0279467
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_medium_nhwc_tn_v1 Tactic: 8101703987960976805
[11/24/2022-12:14:24] [V] [TRT] Tactic: 8101703987960976805 Time: 0.0455429
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: 8170606396342855895
[11/24/2022-12:14:24] [V] [TRT] Tactic: 8170606396342855895 Time: 0.0451109
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 8764780417487154889
[11/24/2022-12:14:24] [V] [TRT] Tactic: 8764780417487154889 Time: 0.0315584
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 8839784824303350101
[11/24/2022-12:14:24] [V] [TRT] Tactic: 8839784824303350101 Time: 0.0207824
[11/24/2022-12:14:24] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -9009272790678027912
[11/24/2022-12:14:25] [V] [TRT] Tactic: -9009272790678027912 Time: 0.0311653
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -8604374562669615024
[11/24/2022-12:14:25] [V] [TRT] Tactic: -8604374562669615024 Time: 0.0612891
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -8280443484414412687
[11/24/2022-12:14:25] [V] [TRT] Tactic: -8280443484414412687 Time: 0.0337106
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8205952393017864204
[11/24/2022-12:14:25] [V] [TRT] Tactic: -8205952393017864204 Time: 0.0315694
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -8131857373260504832
[11/24/2022-12:14:25] [V] [TRT] Tactic: -8131857373260504832 Time: 0.0232751
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7410012245391920273
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7410012245391920273 Time: 0.06544
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -7099920365135295801
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7099920365135295801 Time: 0.0314798
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_interior_nhwc_tn_v1 Tactic: -7089118800560870395
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7089118800560870395 Time: 0.0537493
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x6_medium_nhwc_tn_v1 Tactic: -6356316196810535311
[11/24/2022-12:14:25] [V] [TRT] Tactic: -6356316196810535311 Time: 0.0716091
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -6063766379489217211
[11/24/2022-12:14:25] [V] [TRT] Tactic: -6063766379489217211 Time: 0.0395703
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -5530886555766748586
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5530886555766748586 Time: 0.0288018
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -5409588854490562130
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5409588854490562130 Time: 0.0150272
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -5261787675443473128
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5261787675443473128 Time: 0.0286821
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5161596964442251102
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5161596964442251102 Time: 0.0477455
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5127240325355316006
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5127240325355316006 Time: 0.0399909
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x128_ldg8_relu_exp_stages_64x3_medium_nhwc_tn_v1 Tactic: -5109582882231362997
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5109582882231362997 Time: 0.0359463
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -4950923835688973492
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4950923835688973492 Time: 0.0261554
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_small_nhwc_tn_v1 Tactic: -4796511246675321840
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4796511246675321840 Time: 0.0775863
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_sliced1x2_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4548822885169694805
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4548822885169694805 Time: 0.0422
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -4379519430184503304
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4379519430184503304 Time: 0.025955
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_interior_nhwc_tn_v1 Tactic: -4293222705763522367
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4293222705763522367 Time: 0.0371623
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -4152066959007262150
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4152066959007262150 Time: 0.034133
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -4021926646879732549
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4021926646879732549 Time: 0.0644404
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x4_medium_nhwc_tn_v1 Tactic: -3987638434926559037
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3987638434926559037 Time: 0.0801966
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -3905653247016903130
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3905653247016903130 Time: 0.0314231
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -3903342530518878192
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3903342530518878192 Time: 0.0202457
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: -3864869056275745423
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3864869056275745423 Time: 0.0207928
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x5_small_nhwc_tn_v1 Tactic: -3601464762214218301
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3601464762214218301 Time: 0.0396343
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_sliced1x2_ldg8_relu_exp_stages_64x3_small_nhwc_tn_v1 Tactic: -3058330359340425555
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3058330359340425555 Time: 0.0477029
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: -2878731503146438856
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2878731503146438856 Time: 0.0179611
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2602982885923184927
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2602982885923184927 Time: 0.0449829
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -2353603993968373338
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2353603993968373338 Time: 0.0288677
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -2032577876140256150
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2032577876140256150 Time: 0.0424446
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -2003055242756584050
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2003055242756584050 Time: 0.0384
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: -1985778916402815946
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1985778916402815946 Time: 0.0207922
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_sliced1x2_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -1640527254204634147
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1640527254204634147 Time: 0.0265684
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: -1562548049711204899
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1562548049711204899 Time: 0.0285943
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x128_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1242202084391243207
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1242202084391243207 Time: 0.0611688
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_64x64_ldg8_relu_exp_stages_64x6_small_nhwc_tn_v1 Tactic: -1099247066487349374
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1099247066487349374 Time: 0.0567909
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x4_interior_nhwc_tn_v1 Tactic: -1038291877007553549
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1038291877007553549 Time: 0.0369886
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: -406984317033388136
[11/24/2022-12:14:25] [V] [TRT] Tactic: -406984317033388136 Time: 0.0317074
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_h16816cudnn_128x64_ldg8_relu_exp_stages_64x3_interior_nhwc_tn_v1 Tactic: -331499326992534460
[11/24/2022-12:14:25] [V] [TRT] Tactic: -331499326992534460 Time: 0.0258088
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -5409588854490562130 Time: 0.0150272
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5409588854490562130
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Half(473088,1:16,5376,32) -> Half(29568,1:16,336,2) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Half(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CublasConvolution)
[11/24/2022-12:14:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:25] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Int8(1892352,14784:4,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CudaDepthwiseConvolution)
[11/24/2022-12:14:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: 1508480131241957639
[11/24/2022-12:14:25] [V] [TRT] Tactic: 1508480131241957639 Time: 0.061347
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 2141154648944475104
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2141154648944475104 Time: 0.0612556
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 3239257003214966313
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3239257003214966313 Time: 0.0615619
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_small_nn_v1 Tactic: 5592640619112287921
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5592640619112287921 Time: 0.0259223
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: 7621465827583909090
[11/24/2022-12:14:25] [V] [TRT] Tactic: 7621465827583909090 Time: 0.0342702
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -6580271968881459581
[11/24/2022-12:14:25] [V] [TRT] Tactic: -6580271968881459581 Time: 0.0208424
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: -5576936487443445631
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5576936487443445631 Time: 0.0343259
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_interior_nn_v1 Tactic: -4443833619060044580
[11/24/2022-12:14:25] [V] [TRT] Tactic: -4443833619060044580 Time: 0.0260419
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: -2297737319934264721
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2297737319934264721 Time: 0.0212101
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_xregs_medium_nn_v1 Tactic: -1425085658556684465
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1425085658556684465 Time: 0.026141
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -108011214168778087
[11/24/2022-12:14:25] [V] [TRT] Tactic: -108011214168778087 Time: 0.0206537
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -42427192380281294
[11/24/2022-12:14:25] [V] [TRT] Tactic: -42427192380281294 Time: 0.0340864
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -108011214168778087 Time: 0.0206537
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -108011214168778087
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3426497547019031858 Time: 0.0162138
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 5104832031493112835
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5104832031493112835 Time: 0.016675
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5287526117701381005 Time: 0.0178403
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: 3426497547019031858 Time: 0.0162138
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3426497547019031858
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Float(14784,14784:32,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2818014835119698671
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2818014835119698671 Time: 0.0186503
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 3721599319722771137
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3721599319722771137 Time: 0.0204891
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: 4178917718361232468
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4178917718361232468 Time: 0.0239619
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 5012796702462679112
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5012796702462679112 Time: 0.0326821
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 6556170942941957134
[11/24/2022-12:14:25] [V] [TRT] Tactic: 6556170942941957134 Time: 0.0302729
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 6618077155362058131
[11/24/2022-12:14:25] [V] [TRT] Tactic: 6618077155362058131 Time: 0.0193177
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: 6969462133921577484
[11/24/2022-12:14:25] [V] [TRT] Tactic: 6969462133921577484 Time: 0.0407063
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8912999970161746151
[11/24/2022-12:14:25] [V] [TRT] Tactic: -8912999970161746151 Time: 0.0268099
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -8893439100868426414
[11/24/2022-12:14:25] [V] [TRT] Tactic: -8893439100868426414 Time: 0.0258438
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: -7988637803896331454
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7988637803896331454 Time: 0.0301714
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -7904635102498369361
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7904635102498369361 Time: 0.0320402
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -7606074703023778034
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7606074703023778034 Time: 0.023968
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: -7282232519526877434
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7282232519526877434 Time: 0.0321435
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -6406011580107094428
[11/24/2022-12:14:25] [V] [TRT] Tactic: -6406011580107094428 Time: 0.0198474
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -5603587790314027122
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5603587790314027122 Time: 0.0240427
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -5416590980288859834
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5416590980288859834 Time: 0.0297024
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3665201838779845683
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3665201838779845683 Time: 0.0306862
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -3644377136375731441
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3644377136375731441 Time: 0.024413
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3502495740607894730
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3502495740607894730 Time: 0.0242263
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -2342404147487779225
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2342404147487779225 Time: 0.0232758
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -1610768292520086910
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1610768292520086910 Time: 0.0238895
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp32_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: -621838502160440068
[11/24/2022-12:14:25] [V] [TRT] Tactic: -621838502160440068 Time: 0.0249737
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: 2818014835119698671 Time: 0.0186503
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2818014835119698671
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Int8(236544,14784:32,168,1) -> Half(14784,14784:32,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_793 (CaskConvolution)
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_medium_nt_v1 Tactic: 424230345342282109
[11/24/2022-12:14:25] [V] [TRT] Tactic: 424230345342282109 Time: 0.0204537
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_medium_nt_v1 Tactic: 2327398338581585326
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2327398338581585326 Time: 0.0309129
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 2881044142075831475
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2881044142075831475 Time: 0.0180646
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_medium_nt_v1 Tactic: 4549109251242445288
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4549109251242445288 Time: 0.0343552
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 5730376045873629665
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5730376045873629665 Time: 0.023407
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x128x64_stage4_warpsize4x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7107586691882206281
[11/24/2022-12:14:25] [V] [TRT] Tactic: 7107586691882206281 Time: 0.026019
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_small_nt_v1 Tactic: 7178538052023824067
[11/24/2022-12:14:25] [V] [TRT] Tactic: 7178538052023824067 Time: 0.0310546
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x64x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1 Tactic: 7507411019787288861
[11/24/2022-12:14:25] [V] [TRT] Tactic: 7507411019787288861 Time: 0.0153691
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_small_nt_v1 Tactic: 7515859573761964679
[11/24/2022-12:14:25] [V] [TRT] Tactic: 7515859573761964679 Time: 0.0341742
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 7563002870293617494
[11/24/2022-12:14:25] [V] [TRT] Tactic: 7563002870293617494 Time: 0.0261349
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 8142426754608472547
[11/24/2022-12:14:25] [V] [TRT] Tactic: 8142426754608472547 Time: 0.02352
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_small_nt_v1 Tactic: -7272221766465547628
[11/24/2022-12:14:25] [V] [TRT] Tactic: -7272221766465547628 Time: 0.0204389
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_medium_nt_v1 Tactic: -6733478368603461850
[11/24/2022-12:14:25] [V] [TRT] Tactic: -6733478368603461850 Time: 0.0203051
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_interior_nt_v1 Tactic: -5817829912551792981
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5817829912551792981 Time: 0.0184646
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -5528442507917877226
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5528442507917877226 Time: 0.0149463
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -3773982102975252832
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3773982102975252832 Time: 0.0179606
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_128x128_ldg16_relu_interior_nt_v1 Tactic: -3556614738549917282
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3556614738549917282 Time: 0.0292846
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x256x64_stage4_warpsize2x4x1_g1_tensor16x8x32_t1r1s1 Tactic: -3514726588976755320
[11/24/2022-12:14:25] [V] [TRT] Tactic: -3514726588976755320 Time: 0.042264
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize32x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -2649556861007671996
[11/24/2022-12:14:25] [V] [TRT] Tactic: -2649556861007671996 Time: 0.0156475
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x128_ldg16_relu_interior_nt_v1 Tactic: -1712174008006584201
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1712174008006584201 Time: 0.0327314
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_singleBuffer_small_nt_v1 Tactic: -1008204680238783384
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1008204680238783384 Time: 0.0194674
[11/24/2022-12:14:25] [V] [TRT] node_of_793 Set Tactic Name: ampere_fp16_i8816cudnn_int8_256x64_ldg16_relu_interior_nt_v1 Tactic: -50323486981480818
[11/24/2022-12:14:25] [V] [TRT] Tactic: -50323486981480818 Time: 0.0188434
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -5528442507917877226 Time: 0.0149463
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5528442507917877226
[11/24/2022-12:14:25] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Float(236544,14784,168,1) -> Float(635712,14784,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (TiledPooling)
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2752769 Time: 0.0240419
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2818305 Time: 0.0206256
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2883841 Time: 0.0206126
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2949377 Time: 0.0259573
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3014913 Time: 0.0208274
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3080449 Time: 0.0208607
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3145985 Time: 0.0212656
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3211521 Time: 0.020463
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3277057 Time: 0.0153609
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3342593 Time: 0.0158377
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3408129 Time: 0.0178641
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3473665 Time: 0.0151808
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3539201 Time: 0.0159462
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3604737 Time: 0.0160015
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3670273 Time: 0.01908
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3735809 Time: 0.0155685
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3801345 Time: 0.0170245
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3866881 Time: 0.015856
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3932417 Time: 0.0141714
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3997953 Time: 0.0159441
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4063489 Time: 0.0162794
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4129025 Time: 0.01928
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4194561 Time: 0.0159553
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4260097 Time: 0.015387
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4325633 Time: 0.0149975
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4391169 Time: 0.0131271
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4456705 Time: 0.0152562
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4522241 Time: 0.0157925
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4587777 Time: 0.019136
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4653313 Time: 0.0156905
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4718849 Time: 0.016989
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4784385 Time: 0.0157225
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4849921 Time: 0.0147931
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4915457 Time: 0.0154144
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4980993 Time: 0.0161564
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5046529 Time: 0.0204963
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5112065 Time: 0.015371
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5177601 Time: 0.0165902
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5243137 Time: 0.0150688
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5308673 Time: 0.0133253
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5374209 Time: 0.0152416
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5439745 Time: 0.0154286
[11/24/2022-12:14:25] [V] [TRT] Tactic: 6553857 Time: 0.0125105
[11/24/2022-12:14:25] [V] [TRT] Tactic: 6750465 Time: 0.014159
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: 6553857 Time: 0.0125105
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (CudnnPooling)
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1 Time: 0.031424
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -1 Time: 0.031424
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (CaskPooling)
[11/24/2022-12:14:25] [V] [TRT] node_of_794 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: -5359392427276731246
[11/24/2022-12:14:25] [V] [TRT] Tactic: -5359392427276731246 Time: 0.0316069
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -5359392427276731246 Time: 0.0316069
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6553857
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Float(59136,1:4,672,4) -> Float(162624,1:4,1848,11) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (CaskPooling)
[11/24/2022-12:14:25] [V] [TRT] node_of_794 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Max_CAlign4 Tactic: 2520638879154713613
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2520638879154713613 Time: 0.0292608
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: 2520638879154713613 Time: 0.0292608
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 2520638879154713613
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Half(236544,14784,168,1) -> Half(635712,14784,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (TiledPooling)
[11/24/2022-12:14:25] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (CudnnPooling)
[11/24/2022-12:14:25] [V] [TRT] Tactic: -1 Time: 0.0315346
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -1 Time: 0.0315346
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (CaskPooling)
[11/24/2022-12:14:25] [V] [TRT] node_of_794 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: -199738247121832930
[11/24/2022-12:14:25] [V] [TRT] Tactic: -199738247121832930 Time: 0.0316727
[11/24/2022-12:14:25] [V] [TRT] Fastest Tactic: -199738247121832930 Time: 0.0316727
[11/24/2022-12:14:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1
[11/24/2022-12:14:25] [V] [TRT] *************** Autotuning format combination: Half(118272,14784:2,168,1) -> Half(325248,14784:2,168,1) ***************
[11/24/2022-12:14:25] [V] [TRT] --------------- Timing Runner: node_of_794 (TiledPooling)
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2752769 Time: 0.0153774
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2818305 Time: 0.0149033
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2883841 Time: 0.0149001
[11/24/2022-12:14:25] [V] [TRT] Tactic: 2949377 Time: 0.0165455
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3014913 Time: 0.0147767
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3080449 Time: 0.0149019
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3145985 Time: 0.0149806
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3211521 Time: 0.0133856
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3277057 Time: 0.0124255
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3342593 Time: 0.0122057
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3408129 Time: 0.0126206
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3473665 Time: 0.0119211
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3539201 Time: 0.0123029
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3604737 Time: 0.0123025
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3670273 Time: 0.0128556
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3735809 Time: 0.0122884
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3801345 Time: 0.0124179
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3866881 Time: 0.0126187
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3932417 Time: 0.0120149
[11/24/2022-12:14:25] [V] [TRT] Tactic: 3997953 Time: 0.0122038
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4063489 Time: 0.0123794
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4129025 Time: 0.0125234
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4194561 Time: 0.012048
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4260097 Time: 0.0120937
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4325633 Time: 0.0119048
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4391169 Time: 0.0108232
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4456705 Time: 0.0117577
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4522241 Time: 0.0118558
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4587777 Time: 0.012971
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4653313 Time: 0.0124869
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4718849 Time: 0.0126347
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4784385 Time: 0.0125276
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4849921 Time: 0.0120842
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4915457 Time: 0.0127322
[11/24/2022-12:14:25] [V] [TRT] Tactic: 4980993 Time: 0.0124667
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5046529 Time: 0.0149751
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5112065 Time: 0.0134703
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5177601 Time: 0.0149536
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5243137 Time: 0.0148366
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5308673 Time: 0.012445
[11/24/2022-12:14:25] [V] [TRT] Tactic: 5374209 Time: 0.0129261
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5439745 Time: 0.0141324
[11/24/2022-12:14:26] [V] [TRT] Tactic: 6553857 Time: 0.00993646
[11/24/2022-12:14:26] [V] [TRT] Tactic: 6750465 Time: 0.0100133
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: 6553857 Time: 0.00993646
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_794 (CudaPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -3 Time: 0.0151355
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -3 Time: 0.0151355
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6553857
[11/24/2022-12:14:26] [V] [TRT] *************** Autotuning format combination: Half(29568,1:8,336,2) -> Half(88704,1:8,1008,6) ***************
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_794 (TiledPooling)
[11/24/2022-12:14:26] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_794 (CudaPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -2 Time: 0.013841
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -2 Time: 0.013841
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_794 (CudnnPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -1 Time: 0.021344
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -1 Time: 0.021344
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_794 (CaskPooling)
[11/24/2022-12:14:26] [V] [TRT] node_of_794 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 7355406256274288179
[11/24/2022-12:14:26] [V] [TRT] Tactic: 7355406256274288179 Time: 0.0212741
[11/24/2022-12:14:26] [V] [TRT] node_of_794 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: -1557432339347551130
[11/24/2022-12:14:26] [V] [TRT] Tactic: -1557432339347551130 Time: 0.0271985
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: 7355406256274288179 Time: 0.0212741
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -2
[11/24/2022-12:14:26] [V] [TRT] =============== Computing costs for 
[11/24/2022-12:14:26] [V] [TRT] *************** Autotuning format combination: Float(14784,14784,168,1) -> Float(310464,14784,168,1) ***************
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (TiledPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2752769 Time: 0.00665704
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2818305 Time: 0.00638788
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2883841 Time: 0.00634971
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2949377 Time: 0.00649938
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3014913 Time: 0.00637615
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3080449 Time: 0.00671855
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3145985 Time: 0.00643299
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3211521 Time: 0.00652571
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3277057 Time: 0.00640318
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3342593 Time: 0.00634693
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3408129 Time: 0.00681208
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3473665 Time: 0.00656561
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3539201 Time: 0.00644293
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3604737 Time: 0.00622947
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3670273 Time: 0.00662961
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3735809 Time: 0.00656145
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3801345 Time: 0.00638092
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3866881 Time: 0.00649662
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3932417 Time: 0.00647175
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3997953 Time: 0.00671044
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4063489 Time: 0.00646798
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4129025 Time: 0.00666348
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4194561 Time: 0.00663605
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4260097 Time: 0.00655023
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4325633 Time: 0.00688479
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4391169 Time: 0.00657309
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4456705 Time: 0.00663418
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4522241 Time: 0.00646301
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4587777 Time: 0.00670982
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4653313 Time: 0.00653735
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4718849 Time: 0.00667657
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4784385 Time: 0.00682688
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4849921 Time: 0.0067547
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4915457 Time: 0.00666036
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4980993 Time: 0.00665475
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5046529 Time: 0.00697339
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5112065 Time: 0.00677506
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5177601 Time: 0.00672914
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5243137 Time: 0.00717486
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5308673 Time: 0.00681404
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5374209 Time: 0.00665475
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5439745 Time: 0.00668405
[11/24/2022-12:14:26] [V] [TRT] Tactic: 6553857 Time: 0.00612133
[11/24/2022-12:14:26] [V] [TRT] Tactic: 6750465 Time: 0.00651449
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: 6553857 Time: 0.00612133
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CudnnPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -1 Time: 0.0119752
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -1 Time: 0.0119752
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CaskPooling)
[11/24/2022-12:14:26] [V] [TRT] node_of_795 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: -5359392427276731246
[11/24/2022-12:14:26] [V] [TRT] Tactic: -5359392427276731246 Time: 0.0123242
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -5359392427276731246 Time: 0.0123242
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6553857
[11/24/2022-12:14:26] [V] [TRT] *************** Autotuning format combination: Float(14784,1:4,168,1) -> Float(88704,1:4,1008,6) ***************
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CaskPooling)
[11/24/2022-12:14:26] [V] [TRT] node_of_795 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NHWC_Max_CAlign4 Tactic: 2520638879154713613
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2520638879154713613 Time: 0.0104748
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: 2520638879154713613 Time: 0.0104748
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskPooling Tactic: 2520638879154713613
[11/24/2022-12:14:26] [V] [TRT] *************** Autotuning format combination: Half(14784,14784,168,1) -> Half(310464,14784,168,1) ***************
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (TiledPooling)
[11/24/2022-12:14:26] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CudnnPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -1 Time: 0.0121173
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -1 Time: 0.0121173
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CaskPooling)
[11/24/2022-12:14:26] [V] [TRT] node_of_795 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: -199738247121832930
[11/24/2022-12:14:26] [V] [TRT] Tactic: -199738247121832930 Time: 0.0122891
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -199738247121832930 Time: 0.0122891
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: -1
[11/24/2022-12:14:26] [V] [TRT] *************** Autotuning format combination: Half(14784,14784:2,168,1) -> Half(162624,14784:2,168,1) ***************
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (TiledPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2752769 Time: 0.00655751
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2818305 Time: 0.00643856
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2883841 Time: 0.00651699
[11/24/2022-12:14:26] [V] [TRT] Tactic: 2949377 Time: 0.00664146
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3014913 Time: 0.00653714
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3080449 Time: 0.00648288
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3145985 Time: 0.00637277
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3211521 Time: 0.00671377
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3277057 Time: 0.00669257
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3342593 Time: 0.00672665
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3408129 Time: 0.00670088
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3473665 Time: 0.00659138
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3539201 Time: 0.00682182
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3604737 Time: 0.00669278
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3670273 Time: 0.0073152
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3735809 Time: 0.00716229
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3801345 Time: 0.00725783
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3866881 Time: 0.00721211
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3932417 Time: 0.00711184
[11/24/2022-12:14:26] [V] [TRT] Tactic: 3997953 Time: 0.0071968
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4063489 Time: 0.00701192
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4129025 Time: 0.00873573
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4194561 Time: 0.00753516
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4260097 Time: 0.00874756
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4325633 Time: 0.00742583
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4391169 Time: 0.00736
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4456705 Time: 0.00797917
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4522241 Time: 0.00752529
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4587777 Time: 0.00912229
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4653313 Time: 0.00882904
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4718849 Time: 0.00907371
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4784385 Time: 0.0088554
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4849921 Time: 0.00870669
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4915457 Time: 0.00889869
[11/24/2022-12:14:26] [V] [TRT] Tactic: 4980993 Time: 0.00891644
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5046529 Time: 0.00927543
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5112065 Time: 0.00915286
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5177601 Time: 0.00965211
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5243137 Time: 0.00924943
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5308673 Time: 0.00915171
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5374209 Time: 0.00931829
[11/24/2022-12:14:26] [V] [TRT] Tactic: 5439745 Time: 0.00926543
[11/24/2022-12:14:26] [V] [TRT] Tactic: 6553857 Time: 0.00621257
[11/24/2022-12:14:26] [V] [TRT] Tactic: 6750465 Time: 0.00652862
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: 6553857 Time: 0.00621257
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CudaPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -3 Time: 0.00658618
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -3 Time: 0.00658618
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 6553857
[11/24/2022-12:14:26] [V] [TRT] *************** Autotuning format combination: Half(14784,1:8,168,1) -> Half(44352,1:8,504,3) ***************
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (TiledPooling)
[11/24/2022-12:14:26] [V] [TRT] TiledPooling has no valid tactics for this config, skipping
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CudaPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -2 Time: 0.00959269
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -2 Time: 0.00959269
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CudnnPooling)
[11/24/2022-12:14:26] [V] [TRT] Tactic: -1 Time: 0.0128575
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: -1 Time: 0.0128575
[11/24/2022-12:14:26] [V] [TRT] --------------- Timing Runner: node_of_795 (CaskPooling)
[11/24/2022-12:14:26] [V] [TRT] node_of_795 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 7355406256274288179
[11/24/2022-12:14:26] [V] [TRT] Tactic: 7355406256274288179 Time: 0.0124389
[11/24/2022-12:14:26] [V] [TRT] node_of_795 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: -1557432339347551130
[11/24/2022-12:14:26] [V] [TRT] Tactic: -1557432339347551130 Time: 0.0154958
[11/24/2022-12:14:26] [V] [TRT] Fastest Tactic: 7355406256274288179 Time: 0.0124389
[11/24/2022-12:14:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -2
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to node_of_509 (509) from Float(1182720,236544,672,1) to Int8(473088,236544:4,672,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to PWN(node_of_661) (622) from Int8(2772,924:32,42,1) to Float(88704,924,42,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_662 + node_of_663 + node_of_664 (661) from Float(88704,924,42,1) to Int8(2772,924:32,42,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_668 (667) from Half(924,924:32,42,1) to Half(29568,924,42,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_669) (668) from Half(118272,3696,84,1) to Int8(3696,3696:32,84,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_676 (675) from Half(924,924:32,42,1) to Half(29568,924,42,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_677) (676) from Half(118272,3696,84,1) to Int8(3696,3696:32,84,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_685) (684) from Float(354816,14784,168,1) to Int8(88704,14784:4,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 1 to PWN(node_of_685) (535) from Int8(14784,14784:32,168,1) to Int8(88704,14784:4,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_693) (692) from Float(354816,14784,168,1) to Int8(88704,14784:4,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_701) (700) from Float(354816,14784,168,1) to Int8(88704,14784:4,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_709) (708) from Float(354816,14784,168,1) to Int8(88704,14784:4,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to PWN(node_of_718) (717) from Float(354816,14784,168,1) to Int8(88704,14784:4,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to node_of_787 (787) from Float(14784,14784,168,1) to Float(14784,1,168,1)
[11/24/2022-12:14:26] [V] [TRT] Adding reformat layer: Reformatted Input Tensor 0 to node_of_795 (787) from Float(14784,1,168,1) to Float(14784,14784,168,1)
[11/24/2022-12:14:26] [V] [TRT] Formats and tactics selection completed in 401.915 seconds.
[11/24/2022-12:14:26] [V] [TRT] After reformat layers: 133 layers
[11/24/2022-12:14:26] [V] [TRT] Pre-optimized block assignment.
[11/24/2022-12:14:26] [V] [TRT] Block size 1892352
[11/24/2022-12:14:26] [V] [TRT] Block size 1892352
[11/24/2022-12:14:26] [V] [TRT] Block size 1892352
[11/24/2022-12:14:26] [V] [TRT] Block size 1892352
[11/24/2022-12:14:26] [V] [TRT] Block size 5677056
[11/24/2022-12:14:26] [V] [TRT] Block size 1419264
[11/24/2022-12:14:26] [V] [TRT] Block size 473088
[11/24/2022-12:14:26] [V] [TRT] Block size 2365440
[11/24/2022-12:14:26] [V] [TRT] Block size 2365440
[11/24/2022-12:14:26] [V] [TRT] Block size 473088
[11/24/2022-12:14:26] [V] [TRT] Block size 2365440
[11/24/2022-12:14:26] [V] [TRT] Block size 591360
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 709632
[11/24/2022-12:14:26] [V] [TRT] Block size 709632
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 709632
[11/24/2022-12:14:26] [V] [TRT] Block size 709632
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 709632
[11/24/2022-12:14:26] [V] [TRT] Block size 177664
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 532480
[11/24/2022-12:14:26] [V] [TRT] Block size 532480
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 532480
[11/24/2022-12:14:26] [V] [TRT] Block size 532480
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 532480
[11/24/2022-12:14:26] [V] [TRT] Block size 133120
[11/24/2022-12:14:26] [V] [TRT] Block size 37376
[11/24/2022-12:14:26] [V] [TRT] Block size 222208
[11/24/2022-12:14:26] [V] [TRT] Block size 222208
[11/24/2022-12:14:26] [V] [TRT] Block size 37376
[11/24/2022-12:14:26] [V] [TRT] Block size 222208
[11/24/2022-12:14:26] [V] [TRT] Block size 222208
[11/24/2022-12:14:26] [V] [TRT] Block size 37376
[11/24/2022-12:14:26] [V] [TRT] Block size 222208
[11/24/2022-12:14:26] [V] [TRT] Block size 222208
[11/24/2022-12:14:26] [V] [TRT] Block size 74240
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 236544
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 236544
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 1419264
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 1419264
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 1419264
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 1419264
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 1419264
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 473088
[11/24/2022-12:14:26] [V] [TRT] Block size 946176
[11/24/2022-12:14:26] [V] [TRT] Block size 4
[11/24/2022-12:14:26] [V] [TRT] Block size 7569408
[11/24/2022-12:14:26] [V] [TRT] Block size 7569408
[11/24/2022-12:14:26] [V] [TRT] Block size 7569408
[11/24/2022-12:14:26] [V] [TRT] Block size 1892352
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 354816
[11/24/2022-12:14:26] [V] [TRT] Block size 59392
[11/24/2022-12:14:26] [V] [TRT] Block size 4
[11/24/2022-12:14:26] [V] [TRT] Block size 32110186496
[11/24/2022-12:14:26] [V] [TRT] Total Activation Memory: 32188338184
[11/24/2022-12:14:26] [I] [TRT] Detected 1 inputs and 30 output network tensors.
[11/24/2022-12:14:26] [V] [TRT] node_of_511 + node_of_512 + PWN(node_of_513) Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_c32_nn_v1 Tactic: 1100922622480907544
[11/24/2022-12:14:26] [V] [TRT] node_of_517 + node_of_518 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:14:26] [V] [TRT] node_of_519 + node_of_520 + PWN(node_of_521) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x96x64_stage3_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 4796956614760326119
[11/24/2022-12:14:26] [V] [TRT] node_of_525 + node_of_526 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:14:26] [V] [TRT] node_of_527 + node_of_528 + PWN(node_of_529) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:14:26] [V] [TRT] node_of_533 + node_of_534 + node_of_535 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -3825889760337461729
[11/24/2022-12:14:26] [V] [TRT] node_of_536 + node_of_537 + PWN(node_of_538) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:14:26] [V] [TRT] node_of_542 + node_of_543 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:14:26] [V] [TRT] node_of_544 + node_of_545 + PWN(node_of_546) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:14:26] [V] [TRT] node_of_550 + node_of_551 + node_of_552 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:14:26] [V] [TRT] node_of_553 + node_of_554 + PWN(node_of_555) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:14:26] [V] [TRT] node_of_559 + node_of_560 + node_of_561 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1 Tactic: -6510232214299595844
[11/24/2022-12:14:26] [V] [TRT] node_of_562 + node_of_563 + PWN(node_of_564) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -2432868635536396215
[11/24/2022-12:14:26] [V] [TRT] node_of_568 + node_of_569 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:14:26] [V] [TRT] node_of_570 + node_of_571 + PWN(node_of_572) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:14:26] [V] [TRT] node_of_576 + node_of_577 + node_of_578 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:14:26] [V] [TRT] node_of_579 + node_of_580 + PWN(node_of_581) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:14:26] [V] [TRT] node_of_585 + node_of_586 + node_of_587 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:14:26] [V] [TRT] node_of_588 + node_of_589 + PWN(node_of_590) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:14:26] [V] [TRT] node_of_594 + node_of_595 + node_of_596 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:14:26] [V] [TRT] node_of_597 + node_of_598 + PWN(node_of_599) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize192x128x64_stage3_warpsize4x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5562968047117507056
[11/24/2022-12:14:26] [V] [TRT] node_of_603 + node_of_604 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: -8638624340850784688
[11/24/2022-12:14:26] [V] [TRT] node_of_605 + node_of_606 + PWN(node_of_607) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:14:26] [V] [TRT] node_of_611 + node_of_612 + node_of_613 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:14:26] [V] [TRT] node_of_614 + node_of_615 + PWN(node_of_616) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:14:26] [V] [TRT] node_of_620 + node_of_621 + node_of_622 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x96x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -5516472881360101487
[11/24/2022-12:14:26] [V] [TRT] node_of_623 + node_of_624 + PWN(node_of_625) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x192x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1916483171117495388
[11/24/2022-12:14:26] [V] [TRT] node_of_629 + node_of_630 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x32x64_stage4_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -1006589727652607355
[11/24/2022-12:14:26] [V] [TRT] node_of_631 + node_of_632 + PWN(node_of_633) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:14:26] [V] [TRT] node_of_637 + node_of_638 + node_of_639 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:14:26] [V] [TRT] node_of_640 + node_of_641 + PWN(node_of_642) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:14:26] [V] [TRT] node_of_646 + node_of_647 + node_of_648 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x64x64_stage6_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -4455415102719506646
[11/24/2022-12:14:26] [V] [TRT] node_of_649 + node_of_650 + PWN(node_of_651) Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 6793988781414507278
[11/24/2022-12:14:26] [V] [TRT] node_of_655 + node_of_656 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize96x64x64_stage3_warpsize2x2x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: 5204702486885981735
[11/24/2022-12:14:26] [V] [TRT] node_of_657 + node_of_658 + node_of_659 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:26] [V] [TRT] node_of_662 + node_of_663 + node_of_664 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x128x64_stage6_warpsize2x2x1_g1_tensor16x8x32_t1r1s1 Tactic: 6457435868048963632
[11/24/2022-12:14:26] [V] [TRT] node_of_665 + node_of_666 + node_of_667 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:14:26] [V] [TRT] node_of_670 + node_of_671 + node_of_672 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:14:26] [V] [TRT] node_of_673 + node_of_674 + node_of_675 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f16_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -8732118422363495199
[11/24/2022-12:14:26] [V] [TRT] node_of_678 + node_of_679 + node_of_680 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize256x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_simple_t1r1s1 Tactic: -19707840769375107
[11/24/2022-12:14:26] [V] [TRT] node_of_681 + node_of_682 + node_of_683 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_686 + node_of_687 + node_of_688 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:14:26] [V] [TRT] node_of_689 + node_of_690 + node_of_691 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_694 + node_of_695 + node_of_696 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:14:26] [V] [TRT] node_of_697 + node_of_698 + node_of_699 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_702 + node_of_703 + node_of_704 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:14:26] [V] [TRT] node_of_705 + node_of_706 + node_of_707 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_710 + node_of_711 + node_of_712 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: -8626990807754934295
[11/24/2022-12:14:26] [V] [TRT] node_of_713 + node_of_714 + node_of_715 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize64x32x64_stage6_warpsize2x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: -5287526117701381005
[11/24/2022-12:14:26] [V] [TRT] node_of_719 + node_of_720 + node_of_721 Set Tactic Name: ampere_int8x4_icudnn_int8x4_128x32_relu_interior_c32_nn_v1 Tactic: -6934773036503365000
[11/24/2022-12:14:26] [V] [TRT] node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1546787387293556842
[11/24/2022-12:14:26] [V] [TRT] node_of_724 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_727 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_730 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_733 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_736 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_739 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_742 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_745 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1546787387293556842
[11/24/2022-12:14:26] [V] [TRT] node_of_748 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_751 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_754 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_757 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_760 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_763 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_766 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_769 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8i8_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_vect_c_32_tilesize128x128x64_stage4_warpsize2x2x1_g1_tensor16x8x32_t1r3s3 Tactic: -1546787387293556842
[11/24/2022-12:14:26] [V] [TRT] node_of_772 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_775 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_778 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_781 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_784 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_787 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_790 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] node_of_793 Set Tactic Name: sm80_xmma_fprop_implicit_gemm_interleaved_i8f32_i8i32_f32_nchw_vect_c_32kcrs_vect_c_32_nchw_tilesize128x32x64_stage4_warpsize4x1x1_g1_tensor16x8x32_t1r1s1_alignc4_nchw Tactic: 3426497547019031858
[11/24/2022-12:14:26] [V] [TRT] Setting a default quantization params because quantization data is missing for Reformatting CopyNode for Output Tensor 0 to node_of_787
[11/24/2022-12:14:26] [V] [TRT] Setting a default quantization params because quantization data is missing for Reformatting CopyNode for Input Tensor 0 to node_of_795
[11/24/2022-12:14:26] [V] [TRT] Layer: m Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_509 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to node_of_509 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: i copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_511 + node_of_512 + PWN(node_of_513) Host Persistent: 1664 Device Persistent: 355328 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_514 + node_of_515 + PWN(node_of_516) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_517 + node_of_518 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_519 + node_of_520 + PWN(node_of_521) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_522 + node_of_523 + PWN(node_of_524) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_525 + node_of_526 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_527 + node_of_528 + PWN(node_of_529) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_530 + node_of_531 + PWN(node_of_532) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_533 + node_of_534 + node_of_535 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_536 + node_of_537 + PWN(node_of_538) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_539 + node_of_540 + PWN(node_of_541) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_542 + node_of_543 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_544 + node_of_545 + PWN(node_of_546) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_547 + node_of_548 + PWN(node_of_549) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_550 + node_of_551 + node_of_552 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_553 + node_of_554 + PWN(node_of_555) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_556 + node_of_557 + PWN(node_of_558) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_559 + node_of_560 + node_of_561 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_562 + node_of_563 + PWN(node_of_564) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_565 + node_of_566 + PWN(node_of_567) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_568 + node_of_569 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_570 + node_of_571 + PWN(node_of_572) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_573 + node_of_574 + PWN(node_of_575) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_576 + node_of_577 + node_of_578 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_579 + node_of_580 + PWN(node_of_581) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_582 + node_of_583 + PWN(node_of_584) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_585 + node_of_586 + node_of_587 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_588 + node_of_589 + PWN(node_of_590) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_591 + node_of_592 + PWN(node_of_593) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_594 + node_of_595 + node_of_596 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_597 + node_of_598 + PWN(node_of_599) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_600 + node_of_601 + PWN(node_of_602) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_603 + node_of_604 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_605 + node_of_606 + PWN(node_of_607) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_608 + node_of_609 + PWN(node_of_610) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_611 + node_of_612 + node_of_613 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_614 + node_of_615 + PWN(node_of_616) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_617 + node_of_618 + PWN(node_of_619) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_620 + node_of_621 + node_of_622 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_623 + node_of_624 + PWN(node_of_625) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_626 + node_of_627 + PWN(node_of_628) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_629 + node_of_630 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_631 + node_of_632 + PWN(node_of_633) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_634 + node_of_635 + PWN(node_of_636) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_637 + node_of_638 + node_of_639 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_640 + node_of_641 + PWN(node_of_642) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_643 + node_of_644 + PWN(node_of_645) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_646 + node_of_647 + node_of_648 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_649 + node_of_650 + PWN(node_of_651) Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_652 + node_of_653 + PWN(node_of_654) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_655 + node_of_656 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_657 + node_of_658 + node_of_659 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_660 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 1 to PWN(node_of_661) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_661) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_662 + node_of_663 + node_of_664 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_662 + node_of_663 + node_of_664 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_665 + node_of_666 + node_of_667 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_668 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_668 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_669) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_669) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_670 + node_of_671 + node_of_672 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_673 + node_of_674 + node_of_675 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_676 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_676 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_677) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_677) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_678 + node_of_679 + node_of_680 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_681 + node_of_682 + node_of_683 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_684 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_685) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 1 to PWN(node_of_685) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_685) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_686 + node_of_687 + node_of_688 Host Persistent: 1664 Device Persistent: 89088 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_689 + node_of_690 + node_of_691 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_692 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_693) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_693) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_694 + node_of_695 + node_of_696 Host Persistent: 1664 Device Persistent: 89088 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_697 + node_of_698 + node_of_699 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_700 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_701) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_701) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_702 + node_of_703 + node_of_704 Host Persistent: 1664 Device Persistent: 89088 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_705 + node_of_706 + node_of_707 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_708 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_709) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_709) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_710 + node_of_711 + node_of_712 Host Persistent: 1664 Device Persistent: 89088 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_713 + node_of_714 + node_of_715 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_716 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_717 Host Persistent: 24 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to PWN(node_of_718) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: PWN(node_of_718) Host Persistent: 340 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_719 + node_of_720 + node_of_721 Host Persistent: 3200 Device Persistent: 89088 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_724 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_727 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_730 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_733 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_736 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_739 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_742 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_745 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_748 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_751 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_754 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_757 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_760 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_763 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_766 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_769 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_772 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_775 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_778 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_781 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_784 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_787 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to node_of_787 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_790 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_793 Host Persistent: 2240 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_794 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to node_of_795 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: node_of_795 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: 730 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [V] [TRT] Layer: 787 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0
[11/24/2022-12:14:26] [I] [TRT] Total Host Persistent Memory: 173664
[11/24/2022-12:14:26] [I] [TRT] Total Device Persistent Memory: 800768
[11/24/2022-12:14:26] [I] [TRT] Total Scratch Memory: 0
[11/24/2022-12:14:26] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 11 MiB, GPU 6247 MiB
[11/24/2022-12:14:26] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 16.1134ms to assign 8 blocks to 105 nodes requiring 11324928 bytes.
[11/24/2022-12:14:26] [V] [TRT] Optimized block assignment.
[11/24/2022-12:14:26] [V] [TRT] Block size 7569408
[11/24/2022-12:14:26] [V] [TRT] Block size 2365440
[11/24/2022-12:14:26] [V] [TRT] Block size 473088
[11/24/2022-12:14:26] [V] [TRT] Block size 473088
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 118272
[11/24/2022-12:14:26] [V] [TRT] Block size 89088
[11/24/2022-12:14:26] [I] [TRT] Total Activation Memory: 11324928
[11/24/2022-12:14:26] [V] [TRT] Disabling unused tactic source: CUBLAS, CUBLASLT
[11/24/2022-12:14:26] [V] [TRT] Using cuDNN as a tactic source
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +7, now: CPU 2045, GPU 10736 (MiB)
[11/24/2022-12:14:26] [V] [TRT] Engine generation completed in 407.443 seconds.
[11/24/2022-12:14:26] [V] [TRT] Deleting timing cache: 5240 entries, served 15585 hits since creation.
[11/24/2022-12:14:26] [V] [TRT] Engine Layer Information:
Layer(Constant): m, Tactic: 0,  -> (Unnamed Layer* 0) [Constant]_output[Float(1,2,352,672)]
Layer(Reformat): node_of_509, Tactic: 0, (Unnamed Layer* 0) [Constant]_output[Float(1,2,352,672)] -> Reformatted Output Tensor 0 to node_of_509[Float(1,2,352,672)]
Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to node_of_509, Tactic: 0, Reformatted Output Tensor 0 to node_of_509[Float(1,2,352,672)] -> 510[Int8(1,2,352,672)]
Layer(Reformat): i copy, Tactic: 1002, i[Float(1,3,352,672)] -> 510[Int8(1,3,352,672)]
Layer(CaskConvolution): node_of_511 + node_of_512 + PWN(node_of_513), Tactic: 1100922622480907544, 510[Int8(1,5,352,672)] -> 513[Int8(1,32,176,336)]
Layer(CudaDepthwiseConvolution): node_of_514 + node_of_515 + PWN(node_of_516), Tactic: 55, 513[Int8(1,32,176,336)] -> 516[Int8(1,32,176,336)]
Layer(CaskConvolution): node_of_517 + node_of_518, Tactic: -1006589727652607355, 516[Int8(1,32,176,336)] -> 518[Int8(1,16,176,336)]
Layer(CaskConvolution): node_of_519 + node_of_520 + PWN(node_of_521), Tactic: 4796956614760326119, 518[Int8(1,16,176,336)] -> 521[Int8(1,96,176,336)]
Layer(CudaDepthwiseConvolution): node_of_522 + node_of_523 + PWN(node_of_524), Tactic: 27, 521[Int8(1,96,176,336)] -> 524[Int8(1,96,88,168)]
Layer(CaskConvolution): node_of_525 + node_of_526, Tactic: -19707840769375107, 524[Int8(1,96,88,168)] -> 526[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_527 + node_of_528 + PWN(node_of_529), Tactic: -1916483171117495388, 526[Int8(1,24,88,168)] -> 529[Int8(1,144,88,168)]
Layer(CudaDepthwiseConvolution): node_of_530 + node_of_531 + PWN(node_of_532), Tactic: 43, 529[Int8(1,144,88,168)] -> 532[Int8(1,144,88,168)]
Layer(CaskConvolution): node_of_533 + node_of_534 + node_of_535, Tactic: -3825889760337461729, 532[Int8(1,144,88,168)], 526[Int8(1,24,88,168)] -> 535[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_536 + node_of_537 + PWN(node_of_538), Tactic: -1916483171117495388, 535[Int8(1,24,88,168)] -> 538[Int8(1,144,88,168)]
Layer(CudaDepthwiseConvolution): node_of_539 + node_of_540 + PWN(node_of_541), Tactic: -4, 538[Int8(1,144,88,168)] -> 541[Int8(1,144,44,84)]
Layer(CaskConvolution): node_of_542 + node_of_543, Tactic: -19707840769375107, 541[Int8(1,144,44,84)] -> 543[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_544 + node_of_545 + PWN(node_of_546), Tactic: -2432868635536396215, 543[Int8(1,32,44,84)] -> 546[Int8(1,192,44,84)]
Layer(CudaDepthwiseConvolution): node_of_547 + node_of_548 + PWN(node_of_549), Tactic: 51, 546[Int8(1,192,44,84)] -> 549[Int8(1,192,44,84)]
Layer(CaskConvolution): node_of_550 + node_of_551 + node_of_552, Tactic: -6510232214299595844, 549[Int8(1,192,44,84)], 543[Int8(1,32,44,84)] -> 552[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_553 + node_of_554 + PWN(node_of_555), Tactic: -2432868635536396215, 552[Int8(1,32,44,84)] -> 555[Int8(1,192,44,84)]
Layer(CudaDepthwiseConvolution): node_of_556 + node_of_557 + PWN(node_of_558), Tactic: 51, 555[Int8(1,192,44,84)] -> 558[Int8(1,192,44,84)]
Layer(CaskConvolution): node_of_559 + node_of_560 + node_of_561, Tactic: -6510232214299595844, 558[Int8(1,192,44,84)], 552[Int8(1,32,44,84)] -> 561[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_562 + node_of_563 + PWN(node_of_564), Tactic: -2432868635536396215, 561[Int8(1,32,44,84)] -> 564[Int8(1,192,44,84)]
Layer(CudaDepthwiseConvolution): node_of_565 + node_of_566 + PWN(node_of_567), Tactic: -4, 564[Int8(1,192,44,84)] -> 567[Int8(1,192,22,42)]
Layer(CaskConvolution): node_of_568 + node_of_569, Tactic: 5204702486885981735, 567[Int8(1,192,22,42)] -> 569[Int8(1,64,22,42)]
Layer(CaskConvolution): node_of_570 + node_of_571 + PWN(node_of_572), Tactic: -5562968047117507056, 569[Int8(1,64,22,42)] -> 572[Int8(1,384,22,42)]
Layer(CudaDepthwiseConvolution): node_of_573 + node_of_574 + PWN(node_of_575), Tactic: -4, 572[Int8(1,384,22,42)] -> 575[Int8(1,384,22,42)]
Layer(CaskConvolution): node_of_576 + node_of_577 + node_of_578, Tactic: -4455415102719506646, 575[Int8(1,384,22,42)], 569[Int8(1,64,22,42)] -> 578[Int8(1,64,22,42)]
Layer(CaskConvolution): node_of_579 + node_of_580 + PWN(node_of_581), Tactic: -5562968047117507056, 578[Int8(1,64,22,42)] -> 581[Int8(1,384,22,42)]
Layer(CudaDepthwiseConvolution): node_of_582 + node_of_583 + PWN(node_of_584), Tactic: -4, 581[Int8(1,384,22,42)] -> 584[Int8(1,384,22,42)]
Layer(CaskConvolution): node_of_585 + node_of_586 + node_of_587, Tactic: -4455415102719506646, 584[Int8(1,384,22,42)], 578[Int8(1,64,22,42)] -> 587[Int8(1,64,22,42)]
Layer(CaskConvolution): node_of_588 + node_of_589 + PWN(node_of_590), Tactic: -5562968047117507056, 587[Int8(1,64,22,42)] -> 590[Int8(1,384,22,42)]
Layer(CudaDepthwiseConvolution): node_of_591 + node_of_592 + PWN(node_of_593), Tactic: -4, 590[Int8(1,384,22,42)] -> 593[Int8(1,384,22,42)]
Layer(CaskConvolution): node_of_594 + node_of_595 + node_of_596, Tactic: -4455415102719506646, 593[Int8(1,384,22,42)], 587[Int8(1,64,22,42)] -> 596[Int8(1,64,22,42)]
Layer(CaskConvolution): node_of_597 + node_of_598 + PWN(node_of_599), Tactic: -5562968047117507056, 596[Int8(1,64,22,42)] -> 599[Int8(1,384,22,42)]
Layer(CudaDepthwiseConvolution): node_of_600 + node_of_601 + PWN(node_of_602), Tactic: -4, 599[Int8(1,384,22,42)] -> 602[Int8(1,384,22,42)]
Layer(CaskConvolution): node_of_603 + node_of_604, Tactic: -8638624340850784688, 602[Int8(1,384,22,42)] -> 604[Int8(1,96,22,42)]
Layer(CaskConvolution): node_of_605 + node_of_606 + PWN(node_of_607), Tactic: -1916483171117495388, 604[Int8(1,96,22,42)] -> 607[Int8(1,576,22,42)]
Layer(CudaDepthwiseConvolution): node_of_608 + node_of_609 + PWN(node_of_610), Tactic: 43, 607[Int8(1,576,22,42)] -> 610[Int8(1,576,22,42)]
Layer(CaskConvolution): node_of_611 + node_of_612 + node_of_613, Tactic: -5516472881360101487, 610[Int8(1,576,22,42)], 604[Int8(1,96,22,42)] -> 613[Int8(1,96,22,42)]
Layer(CaskConvolution): node_of_614 + node_of_615 + PWN(node_of_616), Tactic: -1916483171117495388, 613[Int8(1,96,22,42)] -> 616[Int8(1,576,22,42)]
Layer(CudaDepthwiseConvolution): node_of_617 + node_of_618 + PWN(node_of_619), Tactic: 43, 616[Int8(1,576,22,42)] -> 619[Int8(1,576,22,42)]
Layer(CaskConvolution): node_of_620 + node_of_621 + node_of_622, Tactic: -5516472881360101487, 619[Int8(1,576,22,42)], 613[Int8(1,96,22,42)] -> 622[Int8(1,96,22,42)]
Layer(CaskConvolution): node_of_623 + node_of_624 + PWN(node_of_625), Tactic: -1916483171117495388, 622[Int8(1,96,22,42)] -> 625[Int8(1,576,22,42)]
Layer(CudaDepthwiseConvolution): node_of_626 + node_of_627 + PWN(node_of_628), Tactic: -4, 625[Int8(1,576,22,42)] -> 628[Int8(1,576,11,21)]
Layer(CaskConvolution): node_of_629 + node_of_630, Tactic: -1006589727652607355, 628[Int8(1,576,11,21)] -> 630[Int8(1,160,11,21)]
Layer(CaskConvolution): node_of_631 + node_of_632 + PWN(node_of_633), Tactic: 6793988781414507278, 630[Int8(1,160,11,21)] -> 633[Int8(1,960,11,21)]
Layer(CudaDepthwiseConvolution): node_of_634 + node_of_635 + PWN(node_of_636), Tactic: -4, 633[Int8(1,960,11,21)] -> 636[Int8(1,960,11,21)]
Layer(CaskConvolution): node_of_637 + node_of_638 + node_of_639, Tactic: -4455415102719506646, 636[Int8(1,960,11,21)], 630[Int8(1,160,11,21)] -> 639[Int8(1,160,11,21)]
Layer(CaskConvolution): node_of_640 + node_of_641 + PWN(node_of_642), Tactic: 6793988781414507278, 639[Int8(1,160,11,21)] -> 642[Int8(1,960,11,21)]
Layer(CudaDepthwiseConvolution): node_of_643 + node_of_644 + PWN(node_of_645), Tactic: -4, 642[Int8(1,960,11,21)] -> 645[Int8(1,960,11,21)]
Layer(CaskConvolution): node_of_646 + node_of_647 + node_of_648, Tactic: -4455415102719506646, 645[Int8(1,960,11,21)], 639[Int8(1,160,11,21)] -> 648[Int8(1,160,11,21)]
Layer(CaskConvolution): node_of_649 + node_of_650 + PWN(node_of_651), Tactic: 6793988781414507278, 648[Int8(1,160,11,21)] -> 651[Int8(1,960,11,21)]
Layer(CudaDepthwiseConvolution): node_of_652 + node_of_653 + PWN(node_of_654), Tactic: -4, 651[Int8(1,960,11,21)] -> 654[Int8(1,960,11,21)]
Layer(CaskConvolution): node_of_655 + node_of_656, Tactic: 5204702486885981735, 654[Int8(1,960,11,21)] -> 656[Int8(1,320,11,21)]
Layer(CaskConvolution): node_of_657 + node_of_658 + node_of_659, Tactic: -5287526117701381005, 656[Int8(1,320,11,21)] -> 659[Float(1,96,11,21)]
Layer(CudnnDeconvolution): node_of_660, Tactic: 1, 659[Float(1,96,11,21)] -> 660[Float(1,96,22,42)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 1 to PWN(node_of_661), Tactic: 1000, 622[Int8(1,96,22,42)] -> Reformatted Input Tensor 1 to PWN(node_of_661)[Float(1,96,22,42)]
Layer(PointWiseV2): PWN(node_of_661), Tactic: 4, 660[Float(1,96,22,42)], Reformatted Input Tensor 1 to PWN(node_of_661)[Float(1,96,22,42)] -> 661[Float(1,96,22,42)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_662 + node_of_663 + node_of_664, Tactic: 1002, 661[Float(1,96,22,42)] -> Reformatted Input Tensor 0 to node_of_662 + node_of_663 + node_of_664[Int8(1,96,22,42)]
Layer(CaskConvolution): node_of_662 + node_of_663 + node_of_664, Tactic: 6457435868048963632, Reformatted Input Tensor 0 to node_of_662 + node_of_663 + node_of_664[Int8(1,96,22,42)] -> 664[Int8(1,96,22,42)]
Layer(CaskConvolution): node_of_665 + node_of_666 + node_of_667, Tactic: -8732118422363495199, 622[Int8(1,96,22,42)] -> 667[Half(1,32,22,42)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_668, Tactic: 1000, 667[Half(1,32,22,42)] -> Reformatted Input Tensor 0 to node_of_668[Half(1,32,22,42)]
Layer(CudnnDeconvolution): node_of_668, Tactic: 0, Reformatted Input Tensor 0 to node_of_668[Half(1,32,22,42)] -> 668[Half(1,32,44,84)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_669), Tactic: 1002, 668[Half(1,32,44,84)] -> Reformatted Input Tensor 0 to PWN(node_of_669)[Int8(1,32,44,84)]
Layer(PointWiseV2): PWN(node_of_669), Tactic: 20, Reformatted Input Tensor 0 to PWN(node_of_669)[Int8(1,32,44,84)], 561[Int8(1,32,44,84)] -> 669[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_670 + node_of_671 + node_of_672, Tactic: -19707840769375107, 669[Int8(1,32,44,84)] -> 672[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_673 + node_of_674 + node_of_675, Tactic: -8732118422363495199, 664[Int8(1,96,22,42)] -> 675[Half(1,32,22,42)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to node_of_676, Tactic: 1000, 675[Half(1,32,22,42)] -> Reformatted Input Tensor 0 to node_of_676[Half(1,32,22,42)]
Layer(CudnnDeconvolution): node_of_676, Tactic: 0, Reformatted Input Tensor 0 to node_of_676[Half(1,32,22,42)] -> 676[Half(1,32,44,84)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_677), Tactic: 1002, 676[Half(1,32,44,84)] -> Reformatted Input Tensor 0 to PWN(node_of_677)[Int8(1,32,44,84)]
Layer(PointWiseV2): PWN(node_of_677), Tactic: 20, Reformatted Input Tensor 0 to PWN(node_of_677)[Int8(1,32,44,84)], 672[Int8(1,32,44,84)] -> 677[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_678 + node_of_679 + node_of_680, Tactic: -19707840769375107, 677[Int8(1,32,44,84)] -> 680[Int8(1,32,44,84)]
Layer(CaskConvolution): node_of_681 + node_of_682 + node_of_683, Tactic: 3426497547019031858, 561[Int8(1,32,44,84)] -> 683[Float(1,24,44,84)]
Layer(CudnnDeconvolution): node_of_684, Tactic: 0, 683[Float(1,24,44,84)] -> 684[Float(1,24,88,168)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_685), Tactic: 0, 684[Float(1,24,88,168)] -> Reformatted Input Tensor 0 to PWN(node_of_685)[Int8(1,24,88,168)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 1 to PWN(node_of_685), Tactic: 0, 535[Int8(1,24,88,168)] -> Reformatted Input Tensor 1 to PWN(node_of_685)[Int8(1,24,88,168)]
Layer(PointWiseV2): PWN(node_of_685), Tactic: 5, Reformatted Input Tensor 0 to PWN(node_of_685)[Int8(1,24,88,168)], Reformatted Input Tensor 1 to PWN(node_of_685)[Int8(1,24,88,168)] -> 685[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_686 + node_of_687 + node_of_688, Tactic: -8626990807754934295, 685[Int8(1,24,88,168)] -> 688[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_689 + node_of_690 + node_of_691, Tactic: 3426497547019031858, 672[Int8(1,32,44,84)] -> 691[Float(1,24,44,84)]
Layer(CudnnDeconvolution): node_of_692, Tactic: 0, 691[Float(1,24,44,84)] -> 692[Float(1,24,88,168)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_693), Tactic: 0, 692[Float(1,24,88,168)] -> Reformatted Input Tensor 0 to PWN(node_of_693)[Int8(1,24,88,168)]
Layer(PointWiseV2): PWN(node_of_693), Tactic: 5, Reformatted Input Tensor 0 to PWN(node_of_693)[Int8(1,24,88,168)], 688[Int8(1,24,88,168)] -> 693[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_694 + node_of_695 + node_of_696, Tactic: -8626990807754934295, 693[Int8(1,24,88,168)] -> 696[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_697 + node_of_698 + node_of_699, Tactic: 3426497547019031858, 680[Int8(1,32,44,84)] -> 699[Float(1,24,44,84)]
Layer(CudnnDeconvolution): node_of_700, Tactic: 0, 699[Float(1,24,44,84)] -> 700[Float(1,24,88,168)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_701), Tactic: 0, 700[Float(1,24,88,168)] -> Reformatted Input Tensor 0 to PWN(node_of_701)[Int8(1,24,88,168)]
Layer(PointWiseV2): PWN(node_of_701), Tactic: 5, Reformatted Input Tensor 0 to PWN(node_of_701)[Int8(1,24,88,168)], 696[Int8(1,24,88,168)] -> 701[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_702 + node_of_703 + node_of_704, Tactic: -8626990807754934295, 701[Int8(1,24,88,168)] -> 704[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_705 + node_of_706 + node_of_707, Tactic: 3426497547019031858, 680[Int8(1,32,44,84)] -> 707[Float(1,24,44,84)]
Layer(CudnnDeconvolution): node_of_708, Tactic: 0, 707[Float(1,24,44,84)] -> 708[Float(1,24,88,168)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_709), Tactic: 0, 708[Float(1,24,88,168)] -> Reformatted Input Tensor 0 to PWN(node_of_709)[Int8(1,24,88,168)]
Layer(PointWiseV2): PWN(node_of_709), Tactic: 5, Reformatted Input Tensor 0 to PWN(node_of_709)[Int8(1,24,88,168)], 704[Int8(1,24,88,168)] -> 709[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_710 + node_of_711 + node_of_712, Tactic: -8626990807754934295, 709[Int8(1,24,88,168)] -> 712[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_713 + node_of_714 + node_of_715, Tactic: -5287526117701381005, 664[Int8(1,96,22,42)] -> 715[Float(1,24,22,42)]
Layer(CudnnDeconvolution): node_of_716, Tactic: 1, 715[Float(1,24,22,42)] -> 716[Float(1,24,44,84)]
Layer(CudnnDeconvolution): node_of_717, Tactic: 0, 716[Float(1,24,44,84)] -> 717[Float(1,24,88,168)]
Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to PWN(node_of_718), Tactic: 0, 717[Float(1,24,88,168)] -> Reformatted Input Tensor 0 to PWN(node_of_718)[Int8(1,24,88,168)]
Layer(PointWiseV2): PWN(node_of_718), Tactic: 5, Reformatted Input Tensor 0 to PWN(node_of_718)[Int8(1,24,88,168)], 712[Int8(1,24,88,168)] -> 718[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_719 + node_of_720 + node_of_721, Tactic: -6934773036503365000, 718[Int8(1,24,88,168)] -> 721[Int8(1,24,88,168)]
Layer(CaskConvolution): node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744, Tactic: -1546787387293556842, 721[Int8(1,24,88,168)] -> node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,512,88,168)]
Layer(CaskConvolution): node_of_724, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_2d[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_727, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_2d[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_730, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> 730[Float(1,16,88,168)]
Layer(CaskConvolution): node_of_733, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_2d[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_736, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_2d[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_739, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_2d[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_742, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_2d[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_745, Tactic: 3426497547019031858, node_of_722 + node_of_723 || node_of_725 + node_of_726 || node_of_728 + node_of_729 || node_of_731 + node_of_732 || node_of_734 + node_of_735 || node_of_737 + node_of_738 || node_of_740 + node_of_741 || node_of_743 + node_of_744[Int8(1,64,88,168)] -> head_3d[Float(1,24,88,168)]
Layer(CaskConvolution): node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768, Tactic: -1546787387293556842, 721[Int8(1,24,88,168)] -> node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,512,88,168)]
Layer(CaskConvolution): node_of_748, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_3d[Float(1,3,88,168)]
Layer(CaskConvolution): node_of_751, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_3d[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_754, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_3d[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_757, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_3d[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_760, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_3d[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_763, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_gcp[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_766, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_gcp[Float(1,8,88,168)]
Layer(CaskConvolution): node_of_769, Tactic: 3426497547019031858, node_of_746 + node_of_747 || node_of_749 + node_of_750 || node_of_752 + node_of_753 || node_of_755 + node_of_756 || node_of_758 + node_of_759 || node_of_761 + node_of_762 || node_of_764 + node_of_765 || node_of_767 + node_of_768[Int8(1,64,88,168)] -> head_gcp[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792, Tactic: -1546787387293556842, 721[Int8(1,24,88,168)] -> node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,512,88,168)]
Layer(CaskConvolution): node_of_772, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_gcp[Float(1,4,88,168)]
Layer(CaskConvolution): node_of_775, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_lane[Float(1,3,88,168)]
Layer(CaskConvolution): node_of_778, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_lane[Float(1,2,88,168)]
Layer(CaskConvolution): node_of_781, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_lane[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_784, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_lane[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_787, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> Reformatted Output Tensor 0 to node_of_787[Float(1,1,88,168)]
Layer(NoOp): Reformatting CopyNode for Output Tensor 0 to node_of_787, Tactic: 0, Reformatted Output Tensor 0 to node_of_787[Float(1,1,88,168)] -> 787[Float(1,1,88,168)]
Layer(CaskConvolution): node_of_790, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_lane[Float(1,7,88,168)]
Layer(CaskConvolution): node_of_793, Tactic: 3426497547019031858, node_of_770 + node_of_771 || node_of_773 + node_of_774 || node_of_776 + node_of_777 || node_of_779 + node_of_780 || node_of_782 + node_of_783 || node_of_785 + node_of_786 || node_of_788 + node_of_789 || node_of_791 + node_of_792[Int8(1,64,88,168)] -> head_lane[Float(1,5,88,168)]
Layer(TiledPooling): node_of_794, Tactic: 6553857, 730[Float(1,16,88,168)] -> head_2d[Float(1,16,88,168)]
Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to node_of_795, Tactic: 0, 787[Float(1,1,88,168)] -> Reformatted Input Tensor 0 to node_of_795[Float(1,1,88,168)]
Layer(TiledPooling): node_of_795, Tactic: 6553857, Reformatted Input Tensor 0 to node_of_795[Float(1,1,88,168)] -> head_lane[Float(1,1,88,168)]
Layer(Reformat): 730 copy, Tactic: 1000, 730[Float(1,16,88,168)] -> head_2d[Float(1,16,88,168)]
Layer(Reformat): 787 copy, Tactic: 0, 787[Float(1,1,88,168)] -> head_lane[Float(1,1,88,168)]
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +2, GPU +8, now: CPU 2, GPU 8 (MiB)
[11/24/2022-12:14:26] [I] Engine built in 412.593 sec.
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1621, GPU 10552 (MiB)
[11/24/2022-12:14:26] [I] [TRT] Loaded engine size: 6 MiB
[11/24/2022-12:14:26] [V] [TRT] Using cuDNN as a tactic source
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +11, now: CPU 1626, GPU 10564 (MiB)
[11/24/2022-12:14:26] [V] [TRT] Deserialization required 24825 microseconds.
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +4, now: CPU 0, GPU 4 (MiB)
[11/24/2022-12:14:26] [I] Engine deserialized in 0.0287603 sec.
[11/24/2022-12:14:26] [V] [TRT] Using cuDNN as a tactic source
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +6, now: CPU 1627, GPU 10564 (MiB)
[11/24/2022-12:14:26] [V] [TRT] Total per-runner device persistent memory is 800768
[11/24/2022-12:14:26] [V] [TRT] Total per-runner host persistent memory is 173664
[11/24/2022-12:14:26] [V] [TRT] Allocated activation device memory of size 11324928
[11/24/2022-12:14:26] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +12, now: CPU 0, GPU 16 (MiB)
[11/24/2022-12:14:26] [I] Using random values for input i
[11/24/2022-12:14:26] [I] Created input binding for i with dimensions 1x3x352x672
[11/24/2022-12:14:26] [I] Using random values for output head_2d
[11/24/2022-12:14:26] [I] Created output binding for head_2d with dimensions 1x43x88x168
[11/24/2022-12:14:26] [I] Using random values for output head_3d
[11/24/2022-12:14:26] [I] Created output binding for head_3d with dimensions 1x32x88x168
[11/24/2022-12:14:26] [I] Using random values for output head_gcp
[11/24/2022-12:14:26] [I] Created output binding for head_gcp with dimensions 1x16x88x168
[11/24/2022-12:14:26] [I] Using random values for output head_lane
[11/24/2022-12:14:26] [I] Created output binding for head_lane with dimensions 1x21x88x168
[11/24/2022-12:14:26] [I] Starting inference
[11/24/2022-12:14:30] [I] Warmup completed 63 queries over 200 ms
[11/24/2022-12:14:30] [I] Timing trace has 1034 queries over 3.00846 s
[11/24/2022-12:14:30] [I] 
[11/24/2022-12:14:30] [I] === Trace details ===
[11/24/2022-12:14:30] [I] Trace averages of 10 runs:
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.18947 ms - Host latency: 3.83893 ms (enqueue 1.22058 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19363 ms - Host latency: 3.84424 ms (enqueue 1.24324 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19644 ms - Host latency: 3.84423 ms (enqueue 1.22711 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.1959 ms - Host latency: 3.84288 ms (enqueue 1.22627 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19339 ms - Host latency: 3.84239 ms (enqueue 1.23425 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19411 ms - Host latency: 3.84067 ms (enqueue 1.14327 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19541 ms - Host latency: 3.8447 ms (enqueue 1.16418 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.1926 ms - Host latency: 3.83931 ms (enqueue 1.18063 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19276 ms - Host latency: 3.84225 ms (enqueue 1.17617 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.1954 ms - Host latency: 3.84495 ms (enqueue 1.11617 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.1886 ms - Host latency: 3.8267 ms (enqueue 1.10685 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.19238 ms - Host latency: 3.83101 ms (enqueue 1.08483 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 3.05478 ms - Host latency: 3.61816 ms (enqueue 1.06851 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8613 ms - Host latency: 3.32382 ms (enqueue 1.14644 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86026 ms - Host latency: 3.32473 ms (enqueue 1.14835 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8624 ms - Host latency: 3.32729 ms (enqueue 1.15027 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8614 ms - Host latency: 3.32641 ms (enqueue 1.07674 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86729 ms - Host latency: 3.33175 ms (enqueue 1.08194 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86752 ms - Host latency: 3.33464 ms (enqueue 1.08447 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86495 ms - Host latency: 3.32834 ms (enqueue 1.07612 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86622 ms - Host latency: 3.33043 ms (enqueue 1.04912 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86576 ms - Host latency: 3.33144 ms (enqueue 1.10873 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86531 ms - Host latency: 3.3296 ms (enqueue 1.07403 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8686 ms - Host latency: 3.33361 ms (enqueue 1.06072 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86379 ms - Host latency: 3.32715 ms (enqueue 1.07634 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86409 ms - Host latency: 3.32921 ms (enqueue 1.10253 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86337 ms - Host latency: 3.33173 ms (enqueue 1.14932 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86301 ms - Host latency: 3.32891 ms (enqueue 1.11418 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86777 ms - Host latency: 3.33359 ms (enqueue 1.06418 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86399 ms - Host latency: 3.32804 ms (enqueue 1.05441 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86716 ms - Host latency: 3.32922 ms (enqueue 1.04103 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86857 ms - Host latency: 3.33544 ms (enqueue 1.04259 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86576 ms - Host latency: 3.32886 ms (enqueue 1.05061 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86169 ms - Host latency: 3.33341 ms (enqueue 1.15316 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86954 ms - Host latency: 3.34086 ms (enqueue 1.11346 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86893 ms - Host latency: 3.33975 ms (enqueue 1.0897 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86733 ms - Host latency: 3.33601 ms (enqueue 1.07181 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86586 ms - Host latency: 3.33608 ms (enqueue 1.05925 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86797 ms - Host latency: 3.34059 ms (enqueue 1.10341 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86444 ms - Host latency: 3.33518 ms (enqueue 1.08159 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86682 ms - Host latency: 3.33698 ms (enqueue 1.07974 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86707 ms - Host latency: 3.3392 ms (enqueue 1.06769 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86891 ms - Host latency: 3.34117 ms (enqueue 1.04991 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86902 ms - Host latency: 3.33931 ms (enqueue 1.06907 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8655 ms - Host latency: 3.33606 ms (enqueue 1.07418 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.867 ms - Host latency: 3.33793 ms (enqueue 1.06071 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86625 ms - Host latency: 3.33593 ms (enqueue 1.06234 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86868 ms - Host latency: 3.33968 ms (enqueue 1.06045 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86522 ms - Host latency: 3.32788 ms (enqueue 1.06622 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86774 ms - Host latency: 3.33411 ms (enqueue 1.09098 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86571 ms - Host latency: 3.32915 ms (enqueue 1.0651 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8655 ms - Host latency: 3.33545 ms (enqueue 1.06858 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86925 ms - Host latency: 3.34075 ms (enqueue 1.05692 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86865 ms - Host latency: 3.33962 ms (enqueue 1.0557 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86644 ms - Host latency: 3.33729 ms (enqueue 1.09326 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8686 ms - Host latency: 3.33867 ms (enqueue 1.113 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86571 ms - Host latency: 3.33828 ms (enqueue 1.07399 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86508 ms - Host latency: 3.33574 ms (enqueue 1.10236 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8668 ms - Host latency: 3.33688 ms (enqueue 1.09163 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86564 ms - Host latency: 3.33606 ms (enqueue 1.07675 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86785 ms - Host latency: 3.33916 ms (enqueue 1.07007 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86639 ms - Host latency: 3.33998 ms (enqueue 1.07885 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86788 ms - Host latency: 3.33949 ms (enqueue 1.07507 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86335 ms - Host latency: 3.33566 ms (enqueue 1.07941 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86353 ms - Host latency: 3.33496 ms (enqueue 1.0895 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8687 ms - Host latency: 3.3386 ms (enqueue 1.06985 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86516 ms - Host latency: 3.33689 ms (enqueue 1.07563 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86741 ms - Host latency: 3.33799 ms (enqueue 1.07703 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86609 ms - Host latency: 3.33657 ms (enqueue 1.08242 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86675 ms - Host latency: 3.33423 ms (enqueue 1.04973 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86423 ms - Host latency: 3.32861 ms (enqueue 1.05935 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86401 ms - Host latency: 3.32817 ms (enqueue 1.06772 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86924 ms - Host latency: 3.33284 ms (enqueue 1.06038 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86782 ms - Host latency: 3.33181 ms (enqueue 1.06125 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86377 ms - Host latency: 3.32771 ms (enqueue 1.09863 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86365 ms - Host latency: 3.33152 ms (enqueue 1.17021 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86626 ms - Host latency: 3.33132 ms (enqueue 1.12039 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8644 ms - Host latency: 3.33188 ms (enqueue 1.14089 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86553 ms - Host latency: 3.32864 ms (enqueue 1.0459 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86318 ms - Host latency: 3.32554 ms (enqueue 1.05437 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86396 ms - Host latency: 3.326 ms (enqueue 1.06331 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86296 ms - Host latency: 3.32344 ms (enqueue 1.0261 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8625 ms - Host latency: 3.32551 ms (enqueue 1.08113 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86702 ms - Host latency: 3.33176 ms (enqueue 1.09529 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86611 ms - Host latency: 3.33057 ms (enqueue 1.06504 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86775 ms - Host latency: 3.3301 ms (enqueue 1.04797 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86428 ms - Host latency: 3.3282 ms (enqueue 1.06384 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86792 ms - Host latency: 3.33188 ms (enqueue 1.06846 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86504 ms - Host latency: 3.33264 ms (enqueue 1.09001 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86604 ms - Host latency: 3.33403 ms (enqueue 1.13635 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86768 ms - Host latency: 3.33386 ms (enqueue 1.08167 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86665 ms - Host latency: 3.32927 ms (enqueue 1.06523 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86404 ms - Host latency: 3.32969 ms (enqueue 1.05679 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86228 ms - Host latency: 3.32673 ms (enqueue 1.11296 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86384 ms - Host latency: 3.33057 ms (enqueue 1.09141 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86514 ms - Host latency: 3.33152 ms (enqueue 1.10688 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86321 ms - Host latency: 3.32861 ms (enqueue 1.14399 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86501 ms - Host latency: 3.33152 ms (enqueue 1.1446 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86479 ms - Host latency: 3.33062 ms (enqueue 1.09255 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86553 ms - Host latency: 3.32959 ms (enqueue 1.06665 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86707 ms - Host latency: 3.33069 ms (enqueue 1.05459 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.86509 ms - Host latency: 3.32993 ms (enqueue 1.07261 ms)
[11/24/2022-12:14:30] [I] Average on 10 runs - GPU latency: 2.8666 ms - Host latency: 3.3322 ms (enqueue 1.09932 ms)
[11/24/2022-12:14:30] [I] 
[11/24/2022-12:14:30] [I] === Performance summary ===
[11/24/2022-12:14:30] [I] Throughput: 343.697 qps
[11/24/2022-12:14:30] [I] Latency: min = 3.25122 ms, max = 3.90491 ms, mean = 3.39437 ms, median = 3.33661 ms, percentile(99%) = 3.85849 ms
[11/24/2022-12:14:30] [I] Enqueue Time: min = 0.856201 ms, max = 1.56946 ms, mean = 1.09361 ms, median = 1.16412 ms, percentile(99%) = 1.36017 ms
[11/24/2022-12:14:30] [I] H2D Latency: min = 0.0869141 ms, max = 0.14447 ms, mean = 0.107719 ms, median = 0.109131 ms, percentile(99%) = 0.134216 ms
[11/24/2022-12:14:30] [I] GPU Compute Time: min = 2.8465 ms, max = 3.22461 ms, mean = 2.90569 ms, median = 2.86697 ms, percentile(99%) = 3.20807 ms
[11/24/2022-12:14:30] [I] D2H Latency: min = 0.196777 ms, max = 0.549927 ms, mean = 0.380964 ms, median = 0.362793 ms, percentile(99%) = 0.525604 ms
[11/24/2022-12:14:30] [I] Total Host Walltime: 3.00846 s
[11/24/2022-12:14:30] [I] Total GPU Compute Time: 3.00448 s
[11/24/2022-12:14:30] [W] * GPU compute time is unstable, with coefficient of variance = 3.69339%.
[11/24/2022-12:14:30] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.
[11/24/2022-12:14:30] [I] Explanations of the performance metrics are printed in the verbose logs.
[11/24/2022-12:14:30] [V] 
[11/24/2022-12:14:30] [V] === Explanations of the performance metrics ===
[11/24/2022-12:14:30] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed.
[11/24/2022-12:14:30] [V] GPU Compute Time: the GPU latency to execute the kernels for a query.
[11/24/2022-12:14:30] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers.
[11/24/2022-12:14:30] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers.
[11/24/2022-12:14:30] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized.
[11/24/2022-12:14:30] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query.
[11/24/2022-12:14:30] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query.
[11/24/2022-12:14:30] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query.
[11/24/2022-12:14:30] [I] 
&&&& PASSED TensorRT.trtexec [TensorRT v8400] # /usr/src/tensorrt/bin/trtexec --onnx=c3dv2.3.k4.onnx --saveEngine=c3d_best.engine --best --allowGPUFallback --verbose